Re: [geomesa-users] Geomesa with Accumulo 1.6

[Jim Hughes <jnh5y@xxxxxxxx>]

Hi Manas,

No problem; I'm happy to help.  Once we worked through this, perhaps we can sort out a branch which supports CDH 5.3.0.

For the issue with the QuickStart, can you send along more of the stack trace?  Usually, the exception which causes the stack trace is the most important line.  In this case, we are required by licensing issues to exclude cerain jai-core which is where this class lives.  In order to fix things, we'll need to think through the call stack and make a change so that this class is not used.

From chatting with some of the other GeoMesa developers, it sounds like accumulo6 might be a better branch for you to work with.  Can you give it quick try?  I checked the two branches and 'accumulo6' does not have any Glassfish dependencies, so that issue should go away.

I don't think that GeoServer needs the geomesa-assemble jars.  The GeoServer plugin jar contains the jars necessary to run one or two M/R jobs from the GeoMesa GeoServer panel.  (Again, I'd point out that the GeoMesa panel is a nice-to-have feature.)

Thanks,

Jim


On 01/11/2015 08:22 PM, Manas Kar wrote:

Hi Jim, 

 Can't thank you enough for your help. Here are my steps and results.

I tried running the quickstart tutorial which should create 1000 features in an empty table.

My tutorial fails with the following error.

Java.util.concurrent.ExecutionException: java.lang.NoClassDefFoundError: javax/media/jai/util/ImagingListener

Also the acc16_gs26 branch fails to build with hadoop-version 2.5.0-cdh5.3.0(builds fine with hadoop2.2) with the following error

[ERROR] import org.glassfish.grizzly.servlet.ServletContextImpl. 

Only when I build it with hadoop 2.2 and later don't do a clean build the build succeeds.

May be this branch is not fully supported but may be I am missing some thing trivial.

Also the is the geoserver build needs to have the geomesa-assemble jars in it's lib as well?

..Manas

On Fri, Jan 9, 2015 at 6:50 PM, Manas Kar <manasdebashiskar@xxxxxxxxx> wrote:

Hi Jim, 

 Thanks for your elaborate instruction. It definitely took me further then where I was before.

Now I can bring up my geosererver. BUT I don't see the "geomesa pannel" on the left as described in the document http://www.geomesa.org/2014/08/06/geomesa-ui/.

I DO see the Accumulo data store in the stores section but when I apply the proper credentials it gets stuck saying

09 Jan 18:34:54 WARN [org.apache.accumulo.core.client.impl.ServerClient] - Failed to find an available server in the list of servers: [cloudera2ne:10011 (120000), cloudera3ne:10011 (120000), cloudera1ne:10011 (120000)]

NB: I tried both IP and FQDN with the same result.

Am I still missing some jars or any steps? 

My list is given below

#accumulo specific#

• accumulo-trace.jar
  
• accumulo-fate.jar
  
• accumulo-core.jar
  

#As per instruction replaced commons lang 2.1 with 2.4 and commons-configuration

• commons-lang-2.4.jar
  
• commons-configuration-1.6.jar
  

#hadoop specific jars from my cloudera servers.

• hadoop-auth-2.5.0-cdh5.3.0.jar
  
• hadoop-common-2.5.0-cdh5.3.0.jar
  
• hadoop-hdfs-2.5.0-cdh5.3.0.jar
  
• hadoop-mapreduce-client-app-2.5.0-cdh5.3.0.jar
  
• hadoop-mapreduce-client-common-2.5.0-cdh5.3.0.jar
  
• hadoop-yarn-client-2.5.0-cdh5.3.0.jar
  
• hadoop-mapreduce-client-shuffle-2.5.0-cdh5.3.0.jar
  
• hadoop-mapreduce-client-jobclient-2.5.0-cdh5.3.0.jar
  
• hadoop-mapreduce-client-core-2.5.0-cdh5.3.0.jar
  
• hadoop-yarn-client.jar 
• 
  

Question: It is the hadoop client for MR2. Do I need to use one for MR1 instead?

#Thrift jar

• libthrift-0.9.0.jar
  

#xookeeper jar

• zookeeper-3.4.5-cdh5.3.0.jar
  

# plugin(the name says it is 1.5 but it is built with 1.6)

geomesa-distributed-runtime-accumulo1.5-1.0.0-rc.3-SNAPSHOT.jar

#wps jars

• gs-web-wps-2.5.2.jar
  
• gt-xsd-wps-11.2.jar
  
• gt-process-geometry-11.2.jar
  
• gs-wps-core-2.5.2.jar
  
• serializer-2.7.1.jar
  
• net.opengis.wps-11.2.jar
  

Appreciate any help...

Manas

On Thu, Jan 8, 2015 at 3:53 PM, Manas Kar <manasdebashiskar@xxxxxxxxx> wrote:

Hi Experts, 

 I built my Geomesa with Accumulo 1.6 and hadoop.version = 2.5.0-cdh5.3.0

 It was bit convenient because my Cloudera instance provides Accumulo1.6.

 I am now trying to set up Geoserver to show Accumulo Data.

 I am using Geoserver 2.5.2 (With WPS)

 Accumulo1.6.

Geomesa(RC.3)

I am seeing the following error after following the document.

WARNING: Can't load a service for category "DataStoreFactorySpi". Cause is "ServiceConfigurationError: org.geotools.data.DataStoreFactorySpi: Provider org.locationtech.geomesa.core.data.AccumuloDataStoreFactory could not be instantiated".

java.util.ServiceConfigurationError: org.geotools.data.DataStoreFactorySpi: Provider org.locationtech.geomesa.core.data.AccumuloDataStoreFactory could not be instantiated

at java.util.ServiceLoader.fail(ServiceLoader.java:224)

at java.util.ServiceLoader.access$100(ServiceLoader.java:181)

at java.util.ServiceLoader$LazyIterator.next(ServiceLoader.java:377)

at java.util.ServiceLoader$1.next(ServiceLoader.java:445)

at org.geotools.factory.FactoryRegistry.register(FactoryRegistry.java:826)

at org.geotools.factory.FactoryRegistry.scanForPlugins(FactoryRegistry.java:772)

.

.

.

Caused by: java.lang.NoClassDefFoundError: org/apache/hadoop/io/Writable

What am I missing here? Please help.

Thanks

Manas

On Thu, Jan 8, 2015 at 3:30 PM, Manas Kar <manasdebashiskar@xxxxxxxxx> wrote:

Hi, 

 I am trying to make my current Cloudera installation (CDH5.3 with Accumulo 1.6) work with Geomesa.

I saw a help in the Archive suggesting not to use Cloudera provided Accumulo. I was wondering if I can take a different route of compiling Geomesa with Accumulo 1.6?

Also Do I have to change the hadoop version to the Cloudera provided version?

 

Than

_______________________________________________
geomesa-users mailing list
geomesa-users@xxxxxxxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
http://www.locationtech.org/mailman/listinfo/geomesa-users