Thank you Emilio,
I am using anchoring and acknowledgements already.
However, the USE_PROVIDED_FID hint works. I was not aware of this. With this hint, I don’t need the exactly once guarantee.
Cheers,
Nathan
Hi Nathan,
Have you considered just using anchoring and acknowledgements to track your tuples? You don't need trident for the basics - you might not get 'exactly once', but it should be closer. See:
http://storm.apache.org/releases/1.0.1/Guaranteeing-message-processing.html
Also, in general re-writing a feature to GeoMesa will not cause any problems as long as the feature has not changed. So you should be fine re-writing the occasional feature. Just make sure that you use the geotools hint to set the feature ID to your provided value, otherwise GeoMesa will generate a new feature ID and you will get duplicate entries. See:
http://docs.geotools.org/latest/javadocs/org/geotools/factory/Hints.html#USE_PROVIDED_FID
https://github.com/geotools/geotools/wiki/allow-inserts-to-use-existing-feature-id
Thanks,
Emilio
On 06/03/2016 03:15 PM, Nathan Mercer wrote:
Hi there,
I have tried implementing the Storm ingest example and I was successful. I was also able to apply it to my own data which is polygons stored in Shapefiles.
However, using Storm and Kafka you only get at least once guarantee which means you may ingest data more than once. And I have actually seen this happen with my implementation.
Apparently using Storm’s Trident you are able to get exactly once guarantee. But I have tried and tried and cannot get Trident working. None of the examples I have found online for Trident have a similar use case.
Has anybody been able to implement Trident for ingest? Does it even make sense?
Thanks,
Nathan Mercer
_______________________________________________
geomesa-users mailing list
geomesa-users@xxxxxxxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://www.locationtech.org/mailman/listinfo/geomesa-users
_______________________________________________
geomesa-users mailing list
geomesa-users@xxxxxxxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://www.locationtech.org/mailman/listinfo/geomesa-users