Maven errors building latest Aggregate projects

Dear ODKers,

I'm trying to build the latest Aggregate on my OSX/Eclipse-Indigo system
and am running into a few problems:

First, three Maven dependencies fail (when doing mvn install in the root,
but also in Eclipse when building the GAE version):

[INFO]

··· ------------------------------------------------------------------------ [INFO] Building Common non-test source files latest [INFO] ------------------------------------------------------------------------ [WARNING] The POM for oauth.signpost:signpost-commonshttp4:jar:1.2.1.1-odk-SNAPSHOT is missing, no dependency information available [WARNING] The POM for oauth.signpost:signpost-core:jar:1.2.1.1-odk-SNAPSHOT is missing, no dependency information available [WARNING] The POM for xerces:xercesImpl:jar:2.11.0 is missing, no dependency information available

Also, the GAE build in Eclipse lists 10 "Google App Engine Problem"s, all
of which involve missing SDK jars in WEB-INF/lib. As I mention below, I'm
using SDK v1.6.4 rather than v1.6.1, but I thought I only needed to update
my Eclipse settings and pom.xml accordingly. One of the 10 errors:

The App Engine SDK JAR appengine-api-1.0-sdk-1.6.4.jar is missing in the
WEB-INF/lib directory lib /eclipse-aggregate-gae/war/WEB-INF Unknown Google
App Engine Problem

FYI, I followed CONFIGURE.txt to the letter with the following caveats:

  1. I didn't install Postgresql since I'm only really interested, at
    present, in a mysql build. I expect that this will lead to mvn install
    errors down the line, but I figure that I can deal with those.

  2. I installed the ODK Components components via the jars instructions
    rather than building them locally (as indicated in CONFIGURE.txt).

  3. My GAE SDK (via the Eclipse plug-in) is 1.6.4, so I updated the pom.xml
    accordingly.

  4. My source tree comes from the v1.0.6 branch of the odk.aggregate
    repository, as of April 29, 2012.

Any pointers would be extremely welcome.

Thanks very much in advance,

Chris

Sorry for the mix-up. The ...-odk-SNAPSHOT build of those jars slipped
into 1.0.6 accidentally. The standard jars are fine to use -- you can
remove the -odk-SNAPSHOT from the oauth.signpost.version in the pom.xml.

··· ------------------ Here are additional steps that should have been in the readme.txt in the lib directory (describing how to register the xerces library):

Download the "Xerces2 Java 2.11.0 - zip" from
http://xerces.apache.org/mirrors.cgi
Unzip and in the Xerces-J-bin.2.11.0/xerces-2_11_0 directory:
rename xercesImpl.jar to xercesImpl-2.11.0.jar
mvn install:install-file -Dfile=xercesImpl-2.11.0.jar -DgroupId=xerces
-DartifactId=xercesImpl -Dversion=2.11.0 -Dpackaging=jar -DgeneratePom=true

Unfortunately, Eclipse, GWT, AppEngine and Maven don't play well together
(last time I suffered through it, I was able to get any 3 to work...). So
the Eclipse project (eclipse-aggregate-gae) is a pure Eclipse project and
does not rely on the maven dependencies. Therefore, if you update to the
1.6.4 SDK, you also need to update that Eclipse project configuration to
use the 1.6.4 SDK (select the project, right-click, Properties, expand
Google, choose AppEngine, change to use 1.6.4.

Everything else sounds good.

Mitch

On Mon, Apr 30, 2012 at 2:45 AM, Chris chrislrobert@gmail.com wrote:

Dear ODKers,

I'm trying to build the latest Aggregate on my OSX/Eclipse-Indigo system
and am running into a few problems:

First, three Maven dependencies fail (when doing mvn install in the root,
but also in Eclipse when building the GAE version):

[INFO]

[INFO] Building Common non-test source files latest
[INFO]

[WARNING] The POM for
oauth.signpost:signpost-commonshttp4:jar:1.2.1.1-odk-SNAPSHOT is missing,
no dependency information available
[WARNING] The POM for
oauth.signpost:signpost-core:jar:1.2.1.1-odk-SNAPSHOT is missing, no
dependency information available
[WARNING] The POM for xerces:xercesImpl:jar:2.11.0 is missing, no
dependency information available

Also, the GAE build in Eclipse lists 10 "Google App Engine Problem"s, all
of which involve missing SDK jars in WEB-INF/lib. As I mention below, I'm
using SDK v1.6.4 rather than v1.6.1, but I thought I only needed to update
my Eclipse settings and pom.xml accordingly. One of the 10 errors:

The App Engine SDK JAR appengine-api-1.0-sdk-1.6.4.jar is missing in the
WEB-INF/lib directory lib /eclipse-aggregate-gae/war/WEB-INF Unknown Google
App Engine Problem

FYI, I followed CONFIGURE.txt to the letter with the following caveats:

  1. I didn't install Postgresql since I'm only really interested, at
    present, in a mysql build. I expect that this will lead to mvn install
    errors down the line, but I figure that I can deal with those.

  2. I installed the ODK Components components via the jars instructions
    rather than building them locally (as indicated in CONFIGURE.txt).

  3. My GAE SDK (via the Eclipse plug-in) is 1.6.4, so I updated the pom.xml
    accordingly.

  4. My source tree comes from the v1.0.6 branch of the odk.aggregate
    repository, as of April 29, 2012.

Any pointers would be extremely welcome.

Thanks very much in advance,

Chris

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com

Hello ODKers,
I'm trying to build the latest Aggregate on Windows 8/64-bit using native
OS environment AND inside a VirtualBox VM created from Ubuntu 13.10-amd64
using mvn clean, install and/or Eclipse to experiment with and hopefully
enhance unit/IT tests and test process automation, eventually.

Before I get anywhere close to contributing back, I am hoping you would
point me in the direction as to get beyond some build errors I've
experienced:

··· ----------------------

Using mvn install (after clean) on Win8 native environment using cygwin
shell, I get:
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-compiler-plugin:3.0:compile
(default-compile) on project aggregate-src: Compilation failure
[ERROR] error: Exception thrown while constructing Processor object:
com/google/appengine/tools/compilation/DatastoreCallbacksProcessor :
Unsupported major.minor version 51.0


Using mvn install (after clean) on Windows 64-bit native environment, using
COM shell, http://goo.gl/fTtWZ7I get
[ERROR] (log + comments http://goo.gl/fTtWZ7)
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
goal org.codehaus.mojo:gwt-maven-plugin:2.5.1:compile (gwt-javascript) on
project aggregate-src:

I am thinking the above exception may be due to a limitation on
command-line length limitations by the OS or .exe, as per the discussion
matter, herehttp://mojo.10943.n7.nabble.com/Mysterious-error-during-gwt-compile-td37646.html
.


Using Ubuntu VM inside Win8, I've realized the error:
Failed to execute goal on project aggregate-gae:....artifact: ...
aggregate-gae:src:latest ... could not be found

Any help getting going with maven on the command line would be great for my
learning maven and may lead to some exciting discovery about the advantages
Win8 offers (we'll see how likely that it to be the case, right? :))

Hi Mitch,

Thanks for the quick and helpful reply. Your hints got me to the point
where I'm basically alive, but my build environment is still a bit less
than fully functional.

First, on the "mvn install", I always run out of memory on the gae
(BigTable) database unit test -- and then it skips everything from there.
Luckily, this is after the mysql build and test, but still I wonder if
there's an easy fix? I've included the relevant portion of the Maven output
after my signature below.

Second, after doing the mvn install I add the aggregate-mysql project to
Eclipse, as suggested by CONFIGURE.txt. If I try to build, I get a slew of
different errors. Some representative ones are below:

Maven error (1 of 1):

Plugin execution not covered by lifecycle configuration:
org.codehaus.mojo:build-helper-maven-plugin:1.7:add-source (execution:
add-java-source, phase: generate-sources) pom.xml /aggregate-mysql
line 44 Maven
Project Build Lifecycle Mapping Problem

XML error (1 of 6):

cvc-complex-type.2.4.a: Invalid content was found starting with element
'url-pattern'. One of '{"http://java.sun.com/xml/ns/javaee":web-resource-name}'
is expected. web.xml
/aggregate-mysql/target/emma-it/aggregate-mysql-1.0/WEB-INF line 18 XML
Problem

JSP error (1 of 70 or so)

cal cannot be resolved to a type cal1.jsp
/aggregate-mysql/target/tomcat6x/apache-tomcat-6.0.35/apache-tomcat-6.0.35/webapps/examples/jsp/cal
line
52 JSP Problem

HTML warnings (roughly 7,000)

My solution to these was to disable the Maven, Javascript Validator, and
Validator Builders for the project. Once I did that, I could build with
only warnings. Was that the correct approach?

However, if I build and export a WAR, the WAR isn't as complete as the WAR
output by the Maven build. In particular, it fails to include the
"aggregate-src-latest.jar" in WEB-INF/lib. In fact, the Eclipse-exported
WAR doesn't seem to actually include the Aggregate classes anywhere, unless
they're hidden some place that I haven't noticed. (Actually, it's not that
it's less complete, but rather than the Eclipse-generated WAR exports
different libraries. The WEB-INF/lib output by Maven includes 77 files,
including aggregate-src-latest.jar; the WEB-INF/lib output by Eclipse
includes 87 files, not including aggregate-src-latest.jar.)

This suggests to me that I might use Eclipse to develop and compile, but
that if I want to run/test I should hop into the command window to rebuild
with Maven. Is that what you guys do?

Thanks again, and sorry for the follow-up questions,

Chris

Maven build error (clip from end of output):

May 1, 2012 2:48:02 PM
org.opendatakit.common.persistence.engine.DatastoreAccessMetrics logUsage
INFO: opendatakit.MY_QRT_TABLE,0,0,0,0,0
May 1, 2012 2:48:02 PM
org.opendatakit.common.persistence.engine.DatastoreAccessMetrics logUsage
INFO:
opendatakit.__MY_NAMESPACE__ATTB_5FF06C41_F50B_4420_8B75_F2B2470BC98F,0,0,0,0,0
May 1, 2012 2:48:03 PM
org.opendatakit.common.persistence.engine.DatastoreAccessMetrics logUsage
INFO: opendatakit.__MY_NAMESPACE__PERSON,0,0,0,0,0
May 1, 2012 2:48:04 PM
org.opendatakit.common.persistence.engine.DatastoreAccessMetrics logUsage
INFO: opendatakit.___MY_TABLE,0,0,0,0,0
May 1, 2012 2:48:04 PM
org.opendatakit.common.persistence.engine.DatastoreAccessMetrics logUsage
INFO: -----------------------------------------
org.apache.maven.surefire.booter.SurefireExecutionException: Java heap
space; nested exception is java.lang.OutOfMemoryError: Java heap space
java.lang.OutOfMemoryError: Java heap space
at java.util.jar.Manifest$FastInputStream.(Manifest.java:315)
at java.util.jar.Manifest$FastInputStream.(Manifest.java:310)
at java.util.jar.Manifest.read(Manifest.java:178)
at java.util.jar.Manifest.(Manifest.java:52)
at java.util.jar.JarFile.getManifestFromReference(JarFile.java:167)
at java.util.jar.JarFile.getManifest(JarFile.java:148)
at sun.misc.URLClassPath$JarLoader$2.getManifest(URLClassPath.java:696)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:228)
at java.net.URLClassLoader.access$000(URLClassLoader.java:58)
at java.net.URLClassLoader$1.run(URLClassLoader.java:197)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
at
org.junit.internal.runners.model.EachTestNotifier.addFailure(EachTestNotifier.java:26)
at org.junit.runners.ParentRunner.run(ParentRunner.java:306)
at
org.apache.maven.surefire.junit4.JUnit4TestSet.execute(JUnit4TestSet.java:59)
at
org.apache.maven.surefire.suite.AbstractDirectoryTestSuite.executeTestSet(AbstractDirectoryTestSuite.java:120)
at
org.apache.maven.surefire.suite.AbstractDirectoryTestSuite.execute(AbstractDirectoryTestSuite.java:103)
at org.apache.maven.surefire.Surefire.run(Surefire.java:169)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.maven.surefire.booter.SurefireBooter.runSuitesInProcess(SurefireBooter.java:350)
at
org.apache.maven.surefire.booter.SurefireBooter.main(SurefireBooter.java:1021)
[INFO]

··· ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] ODK Aggregate ..................................... SUCCESS [0.206s] [INFO] Common non-test source files ...................... SUCCESS [3.194s] [INFO] Configuration for GAE ............................. SUCCESS [0.573s] [INFO] Integration Test Configuration for GAE ............ SUCCESS [0.632s] [INFO] Unit Test Configuration for GAE ................... SUCCESS [0.609s] [INFO] Configuration for MySQL ........................... SUCCESS [0.527s] [INFO] Integration Test Configuration for MySQL .......... SUCCESS [0.632s] [INFO] Unit Test Configuration for MySQL ................. SUCCESS [0.584s] [INFO] Configuration for PostgreSQL ...................... SUCCESS [0.543s] [INFO] Integration Test Configuration for PostgreSQL ..... SUCCESS [0.610s] [INFO] Unit Test Configuration for PostgreSQL ............ SUCCESS [0.584s] [INFO] ODK Aggregate for MySQL ........................... SUCCESS [42.912s] [INFO] Unit tests against mysql database ................. SUCCESS [1:52.194s] [INFO] Unit tests against gae (BigTable) database ........ FAILURE [2:11.347s] [INFO] ODK Aggregate for Google Appengine ................ SKIPPED [INFO] ODK Aggregate for PostgreSQL ...................... SKIPPED [INFO] Unit tests against postgres database .............. SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 4:55.803s [INFO] Finished at: Tue May 01 14:48:07 CAT 2012 [INFO] Final Memory: 36M/114M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.6:test (default-test) on project gae-unit-tests: There are test failures.

On Monday, April 30, 2012, Mitch S wrote:

Sorry for the mix-up. The ...-odk-SNAPSHOT build of those jars slipped
into 1.0.6 accidentally. The standard jars are fine to use -- you can
remove the -odk-SNAPSHOT from the oauth.signpost.version in the pom.xml.

Here are additional steps that should have been in the readme.txt in the
lib directory (describing how to register the xerces library):

Download the "Xerces2 Java 2.11.0 - zip" from
http://xerces.apache.org/mirrors.cgi
Unzip and in the Xerces-J-bin.2.11.0/xerces-2_11_0 directory:
rename xercesImpl.jar to xercesImpl-2.11.0.jar
mvn install:install-file -Dfile=xercesImpl-2.11.0.jar -DgroupId=xerces
-DartifactId=xercesImpl -Dversion=2.11.0 -Dpackaging=jar -DgeneratePom=true

Unfortunately, Eclipse, GWT, AppEngine and Maven don't play well together
(last time I suffered through it, I was able to get any 3 to work...). So
the Eclipse project (eclipse-aggregate-gae) is a pure Eclipse project and
does not rely on the maven dependencies. Therefore, if you update to the
1.6.4 SDK, you also need to update that Eclipse project configuration to
use the 1.6.4 SDK (select the project, right-click, Properties, expand
Google, choose AppEngine, change to use 1.6.4.

Everything else sounds good.

Mitch

On Mon, Apr 30, 2012 at 2:45 AM, Chris <chrislrobert@gmail.com<javascript:_e({}, 'cvml', 'chrislrobert@gmail.com');> wrote:

Dear ODKers,

I'm trying to build the latest Aggregate on my OSX/Eclipse-Indigo system
and am running into a few problems:

First, three Maven dependencies fail (when doing mvn install in the root,
but also in Eclipse when building the GAE version):

[INFO]

[INFO] Building Common non-test source files latest
[INFO]

[WARNING] The POM for
oauth.signpost:signpost-commonshttp4:jar:1.2.1.1-odk-SNAPSHOT is missing,
no dependency information available
[WARNING] The POM for
oauth.signpost:signpost-core:jar:1.2.1.1-odk-SNAPSHOT is missing, no
dependency information available
[WARNING] The POM for xerces:xercesImpl:jar:2.11.0 is missing, no
dependency information available

Also, the GAE build in Eclipse lists 10 "Google App Engine Problem"s, all
of which involve missing SDK jars in WEB-INF/lib. As I mention below, I'm
using SDK v1.6.4 rather than v1.6.1, but I thought I only needed to update
my Eclipse settings and pom.xml accordingly. One of the 10 errors:

The App Engine SDK JAR appengine-api-1.0-sdk-1.6.4.jar is missing in the
WEB-INF/lib directory lib /eclipse-aggregate-gae/war/WEB-INF Unknown Google
App Engine Problem

FYI, I followed CONFIGURE.txt to the letter with the following caveats:

  1. I didn't install Postgresql since I'm only really interested, at
    present, in a mysql build. I expect that this will lead to mvn install
    errors down the line, but I figure that I can deal with those.

  2. I installed the ODK Components components via the jars instructions
    rather than building them locally (as indicated in CONFIGURE.txt).

  3. My GAE SDK (via the Eclipse plug-in) is 1.6.4, so I updated the
    pom.xml accordingly.

  4. My source tree comes from the v1.0.6 branch of the odk.aggregate
    repository, as of April 29, 2012.

Any pointers would be extremely welcome.

Thanks very much in advance,

Chris

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com <javascript:_e({}, 'cvml',
'mitchellsundt@gmail.com');>

The cryptic version error is complaining that you have Java 6 installed,
and the Google AppEngine SDK needs Java 7.

I've never seen a command line length exceeded error during my builds on
Windows 7 64-bit.

You also need to follow all the steps outlined in CONFIGURE.txt in the root
directory of the project. There are a lot of files you need to manually
add to Maven to get it to build.

The code also requires Firefox ESR 17 for the integration tests.

I have not had time to update the jars for the project.

It would be absolutely wonderful if you added more IT tests using
Selenium.

Mitch

··· On Sat, Feb 15, 2014 at 5:58 AM, Chris Cargile wrote:

Hello ODKers,
I'm trying to build the latest Aggregate on Windows 8/64-bit using native
OS environment AND inside a VirtualBox VM created from Ubuntu 13.10-amd64
using mvn clean, install and/or Eclipse to experiment with and hopefully
enhance unit/IT tests and test process automation, eventually.

Before I get anywhere close to contributing back, I am hoping you would
point me in the direction as to get beyond some build errors I've
experienced:


Using mvn install (after clean) on Win8 native environment using cygwin
shell, I get:
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-compiler-plugin:3.0:compile
(default-compile) on project aggregate-src: Compilation failure
[ERROR] error: Exception thrown while constructing Processor object:
com/google/appengine/tools/compilation/DatastoreCallbacksProcessor :
Unsupported major.minor version 51.0


Using mvn install (after clean) on Windows 64-bit native environment,
using COM shell, http://goo.gl/fTtWZ7I get
[ERROR] (log + comments http://goo.gl/fTtWZ7)
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
goal org.codehaus.mojo:gwt-maven-plugin:2.5.1:compile (gwt-javascript) on
project aggregate-src:

I am thinking the above exception may be due to a limitation on
command-line length limitations by the OS or .exe, as per the discussion
matter, herehttp://mojo.10943.n7.nabble.com/Mysterious-error-during-gwt-compile-td37646.html
.


Using Ubuntu VM inside Win8, I've realized the error:
Failed to execute goal on project aggregate-gae:....artifact: ...
aggregate-gae:src:latest ... could not be found

Any help getting going with maven on the command line would be great for
my learning maven and may lead to some exciting discovery about the
advantages Win8 offers (we'll see how likely that it to be the case, right?
:))

--
You received this message because you are subscribed to the Google Groups
"ODK Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit-developers+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com

I currently develop in Eclipse against the AppEngine development
environment. To produce the installer image, I then:
mvn clean
mvn install
copy the aggregate-mysql\target\aggregate-mysql-1.0.war into the
bitrock-installer directory
cd bitrock-installer
mvn clean
mvn install
Then open the Bitrock installer, open the build.xml definition file, update
the version, and build the various installers.

It appears that you can now use Maven within Eclipse (fixes below). So you
can build the MySQL build and run it within Eclipse. Note that the
maven-based builds split the source compilation so that the server source
files are compiled into a jar by the aggregate-src project. The UI files
are then separately compiled and placed into the war file by the individual
projects (e.g., aggregate-mysql). So if you do develop using these
maven-based projects within eclipse, you need to be sure that the
aggregate-src-latest.jar is being properly rebuilt (by the aggregate-src
project). I doubt on-the-fly editing will work like it does in the
eclipse-aggregate-gae project (and note that the maven-based gae build is
aggregate-gae, which mirrors the structures of aggregate-mysql and
aggregate-postgres).

Ah yes, I forgot about the JVM settings...

For Eclipse, you will want to edit the eclipse.ini file. This is in the
eclipse folder (where eclipse.exe is). When you run as a Web Applicaiton,
it starts 2 copies of all the code (one for the foreground web server, one
for the background server), and runs out of Perm space (code space).

I don't know what is required (the key values are definitely the
"XXMaxPermSize 512m" and the -Xmx1024m). I have:

-startup
plugins/org.eclipse.equinox.launcher_1.2.0.v20110502.jar
--launcher.library
plugins/org.eclipse.equinox.launcher.win32.win32.x86_64_1.1.100.v20110502
-product
org.eclipse.epp.package.jee.product
--launcher.defaultAction
openFile
--launcher.XXMaxPermSize
512M
-showsplash
org.eclipse.platform
--launcher.XXMaxPermSize
512m
--launcher.defaultAction
openFile
-vmargs
-Dosgi.requiredJavaVersion=1.5
-Xms100m
-Xmx1024m

··· ------------------------------------------- Additional Eclipse configuration for Maven. On the Window / Preferences page:

Java / Installed JREs:

Add the JDK path. (needed only for Maven-based builds)

Java / Installed JREs / Execution Environments:

Choose JavaSE-1.6, check the checkbox beside the JDK. (needed only for

Maven-based builds).

====> You will need to exit and restart Eclipse.


SYNC with the repository -- I have checked in new .classpath and .project
files for aggregate-mysql and aggregate-src (the project containing the
source files).

You will want the odk-mysql-it-settings, aggregate-src, aggregate-mysql
projects in your workspace.

With these changes, you can now "Run As -> maven install" to build the
aggregate-mysql project from within Eclipse (this will pop open Firefox and
run two trivial automated tests). Once that build is OK, you can then
Export WAR and it will export the same WAR structure as in the production
install.

The odk-mysql-it-settings-latest.jar is equivalent to the
ODKAggregate-settings.jar of the installer BUT has a login backdoor for the
testing -- the security.properties has:

security.server.superUserUsername=aggregate

Which allows the automated tests to log in with username aggregate,
password aggregate. You will want to either remove that jar and add in the
ODKAggregate-settings.jar produced from the standard install, or tweak the
build environment to alter the settings (which would break the automated
tests), or remember to change that user's password to something other than
'aggregate' in your production environment.

Mitch

Because of the Eclipse/Maven/GWT/AppEngine playing-well difficulties, I now
do development in Eclipse with the eclipse-aggregate-gae project running as
a GWT/AppEngine Web Application

On Tue, May 1, 2012 at 7:24 AM, Christopher Robert chrislrobert@gmail.comwrote:

Hi Mitch,

Thanks for the quick and helpful reply. Your hints got me to the point
where I'm basically alive, but my build environment is still a bit less
than fully functional.

First, on the "mvn install", I always run out of memory on the gae
(BigTable) database unit test -- and then it skips everything from there.
Luckily, this is after the mysql build and test, but still I wonder if
there's an easy fix? I've included the relevant portion of the Maven output
after my signature below.

Second, after doing the mvn install I add the aggregate-mysql project to
Eclipse, as suggested by CONFIGURE.txt. If I try to build, I get a slew of
different errors. Some representative ones are below:

Maven error (1 of 1):

Plugin execution not covered by lifecycle configuration:
org.codehaus.mojo:build-helper-maven-plugin:1.7:add-source (execution:
add-java-source, phase: generate-sources) pom.xml /aggregate-mysql line 44 Maven
Project Build Lifecycle Mapping Problem

XML error (1 of 6):

cvc-complex-type.2.4.a: Invalid content was found starting with element
'url-pattern'. One of '{"http://java.sun.com/xml/ns/javaee":web-resource-name}'
is expected. web.xml
/aggregate-mysql/target/emma-it/aggregate-mysql-1.0/WEB-INF line 18 XML
Problem

JSP error (1 of 70 or so)

cal cannot be resolved to a type cal1.jsp
/aggregate-mysql/target/tomcat6x/apache-tomcat-6.0.35/apache-tomcat-6.0.35/webapps/examples/jsp/cal line
52 JSP Problem

HTML warnings (roughly 7,000)

My solution to these was to disable the Maven, Javascript Validator, and
Validator Builders for the project. Once I did that, I could build with
only warnings. Was that the correct approach?

However, if I build and export a WAR, the WAR isn't as complete as the WAR
output by the Maven build. In particular, it fails to include the
"aggregate-src-latest.jar" in WEB-INF/lib. In fact, the Eclipse-exported
WAR doesn't seem to actually include the Aggregate classes anywhere, unless
they're hidden some place that I haven't noticed. (Actually, it's not that
it's less complete, but rather than the Eclipse-generated WAR exports
different libraries. The WEB-INF/lib output by Maven includes 77 files,
including aggregate-src-latest.jar; the WEB-INF/lib output by Eclipse
includes 87 files, not including aggregate-src-latest.jar.)

This suggests to me that I might use Eclipse to develop and compile, but
that if I want to run/test I should hop into the command window to rebuild
with Maven. Is that what you guys do?

Thanks again, and sorry for the follow-up questions,

Chris

Maven build error (clip from end of output):

May 1, 2012 2:48:02 PM
org.opendatakit.common.persistence.engine.DatastoreAccessMetrics logUsage
INFO: opendatakit.MY_QRT_TABLE,0,0,0,0,0
May 1, 2012 2:48:02 PM
org.opendatakit.common.persistence.engine.DatastoreAccessMetrics logUsage
INFO:
opendatakit.__MY_NAMESPACE__ATTB_5FF06C41_F50B_4420_8B75_F2B2470BC98F,0,0,0,0,0
May 1, 2012 2:48:03 PM
org.opendatakit.common.persistence.engine.DatastoreAccessMetrics logUsage
INFO: opendatakit.__MY_NAMESPACE__PERSON,0,0,0,0,0
May 1, 2012 2:48:04 PM
org.opendatakit.common.persistence.engine.DatastoreAccessMetrics logUsage
INFO: opendatakit.___MY_TABLE,0,0,0,0,0
May 1, 2012 2:48:04 PM
org.opendatakit.common.persistence.engine.DatastoreAccessMetrics logUsage
INFO: -----------------------------------------
org.apache.maven.surefire.booter.SurefireExecutionException: Java heap
space; nested exception is java.lang.OutOfMemoryError: Java heap space
java.lang.OutOfMemoryError: Java heap space
at java.util.jar.Manifest$FastInputStream.(Manifest.java:315)
at java.util.jar.Manifest$FastInputStream.(Manifest.java:310)
at java.util.jar.Manifest.read(Manifest.java:178)
at java.util.jar.Manifest.(Manifest.java:52)
at java.util.jar.JarFile.getManifestFromReference(JarFile.java:167)
at java.util.jar.JarFile.getManifest(JarFile.java:148)
at sun.misc.URLClassPath$JarLoader$2.getManifest(URLClassPath.java:696)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:228)
at java.net.URLClassLoader.access$000(URLClassLoader.java:58)
at java.net.URLClassLoader$1.run(URLClassLoader.java:197)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
at
org.junit.internal.runners.model.EachTestNotifier.addFailure(EachTestNotifier.java:26)
at org.junit.runners.ParentRunner.run(ParentRunner.java:306)
at
org.apache.maven.surefire.junit4.JUnit4TestSet.execute(JUnit4TestSet.java:59)
at
org.apache.maven.surefire.suite.AbstractDirectoryTestSuite.executeTestSet(AbstractDirectoryTestSuite.java:120)
at
org.apache.maven.surefire.suite.AbstractDirectoryTestSuite.execute(AbstractDirectoryTestSuite.java:103)
at org.apache.maven.surefire.Surefire.run(Surefire.java:169)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.maven.surefire.booter.SurefireBooter.runSuitesInProcess(SurefireBooter.java:350)
at
org.apache.maven.surefire.booter.SurefireBooter.main(SurefireBooter.java:1021)
[INFO]

[INFO] Reactor Summary:
[INFO]
[INFO] ODK Aggregate ..................................... SUCCESS [0.206s]
[INFO] Common non-test source files ...................... SUCCESS [3.194s]
[INFO] Configuration for GAE ............................. SUCCESS [0.573s]
[INFO] Integration Test Configuration for GAE ............ SUCCESS [0.632s]
[INFO] Unit Test Configuration for GAE ................... SUCCESS [0.609s]
[INFO] Configuration for MySQL ........................... SUCCESS [0.527s]
[INFO] Integration Test Configuration for MySQL .......... SUCCESS [0.632s]
[INFO] Unit Test Configuration for MySQL ................. SUCCESS [0.584s]
[INFO] Configuration for PostgreSQL ...................... SUCCESS [0.543s]
[INFO] Integration Test Configuration for PostgreSQL ..... SUCCESS [0.610s]
[INFO] Unit Test Configuration for PostgreSQL ............ SUCCESS [0.584s]
[INFO] ODK Aggregate for MySQL ........................... SUCCESS
[42.912s]
[INFO] Unit tests against mysql database ................. SUCCESS
[1:52.194s]
[INFO] Unit tests against gae (BigTable) database ........ FAILURE
[2:11.347s]
[INFO] ODK Aggregate for Google Appengine ................ SKIPPED
[INFO] ODK Aggregate for PostgreSQL ...................... SKIPPED
[INFO] Unit tests against postgres database .............. SKIPPED
[INFO]

[INFO] BUILD FAILURE
[INFO]

[INFO] Total time: 4:55.803s
[INFO] Finished at: Tue May 01 14:48:07 CAT 2012
[INFO] Final Memory: 36M/114M
[INFO]

[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-surefire-plugin:2.6:test (default-test) on
project gae-unit-tests: There are test failures.

On Monday, April 30, 2012, Mitch S wrote:

Sorry for the mix-up. The ...-odk-SNAPSHOT build of those jars slipped
into 1.0.6 accidentally. The standard jars are fine to use -- you can
remove the -odk-SNAPSHOT from the oauth.signpost.version in the pom.xml.

Here are additional steps that should have been in the readme.txt in the
lib directory (describing how to register the xerces library):

Download the "Xerces2 Java 2.11.0 - zip" from
http://xerces.apache.org/mirrors.cgi
Unzip and in the Xerces-J-bin.2.11.0/xerces-2_11_0 directory:
rename xercesImpl.jar to xercesImpl-2.11.0.jar
mvn install:install-file -Dfile=xercesImpl-2.11.0.jar -DgroupId=xerces
-DartifactId=xercesImpl -Dversion=2.11.0 -Dpackaging=jar -DgeneratePom=true

Unfortunately, Eclipse, GWT, AppEngine and Maven don't play well together
(last time I suffered through it, I was able to get any 3 to work...). So
the Eclipse project (eclipse-aggregate-gae) is a pure Eclipse project and
does not rely on the maven dependencies. Therefore, if you update to the
1.6.4 SDK, you also need to update that Eclipse project configuration to
use the 1.6.4 SDK (select the project, right-click, Properties, expand
Google, choose AppEngine, change to use 1.6.4.

Everything else sounds good.

Mitch

On Mon, Apr 30, 2012 at 2:45 AM, Chris chrislrobert@gmail.com wrote:

Dear ODKers,

I'm trying to build the latest Aggregate on my OSX/Eclipse-Indigo system
and am running into a few problems:

First, three Maven dependencies fail (when doing mvn install in the
root, but also in Eclipse when building the GAE version):

[INFO]

[INFO] Building Common non-test source files latest
[INFO]

[WARNING] The POM for
oauth.signpost:signpost-commonshttp4:jar:1.2.1.1-odk-SNAPSHOT is missing,
no dependency information available
[WARNING] The POM for
oauth.signpost:signpost-core:jar:1.2.1.1-odk-SNAPSHOT is missing, no
dependency information available
[WARNING] The POM for xerces:xercesImpl:jar:2.11.0 is missing, no
dependency information available

Also, the GAE build in Eclipse lists 10 "Google App Engine Problem"s,
all of which involve missing SDK jars in WEB-INF/lib. As I mention below,
I'm using SDK v1.6.4 rather than v1.6.1, but I thought I only needed to
update my Eclipse settings and pom.xml accordingly. One of the 10 errors:

The App Engine SDK JAR appengine-api-1.0-sdk-1.6.4.jar is missing in the
WEB-INF/lib directory lib /eclipse-aggregate-gae/war/WEB-INF Unknown Google
App Engine Problem

FYI, I followed CONFIGURE.txt to the letter with the following caveats:

  1. I didn't install Postgresql since I'm only really interested, at
    present, in a mysql build. I expect that this will lead to mvn install
    errors down the line, but I figure that I can deal with those.

  2. I installed the ODK Components components via the jars instructions
    rather than building them locally (as indicated in CONFIGURE.txt).

  3. My GAE SDK (via the Eclipse plug-in) is 1.6.4, so I updated the
    pom.xml accordingly.

  4. My source tree comes from the v1.0.6 branch of the odk.aggregate
    repository, as of April 29, 2012.

Any pointers would be extremely welcome.

Thanks very much in advance,

Chris

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com

Hi Mitch,

Thanks for all of the additional tips. I'll give it a go, but honestly I
don't know that building from Eclipse is all that important to me. I think
that I'll just settle into a routine where I develop in Eclipse and then
"mvn install" to build. That way I know that I'll get clean builds, and
also I'll be scripting the interactions with my Tomcat instance anyway, so
I'll be using the command line regardless.

FYI, my out-of-memory problems were when building straight from "mvn
install" -- not Eclipse -- so in the end I added the following line into
the gae-unit-tests/POM.xml:

-Xms512m -Xmx1024m -XX:MaxPermSize=512m

With that, the unit tests work fine and my full gae+mysql Maven build works
without a hitch. Thus, I think that I am in business.

Thanks again for all of the help,

Chris

··· On Tuesday, May 1, 2012, Mitch S wrote:

I currently develop in Eclipse against the AppEngine development
environment. To produce the installer image, I then:
mvn clean
mvn install
copy the aggregate-mysql\target\aggregate-mysql-1.0.war into the
bitrock-installer directory
cd bitrock-installer
mvn clean
mvn install
Then open the Bitrock installer, open the build.xml definition file,
update the version, and build the various installers.

It appears that you can now use Maven within Eclipse (fixes below). So you
can build the MySQL build and run it within Eclipse. Note that the
maven-based builds split the source compilation so that the server source
files are compiled into a jar by the aggregate-src project. The UI files
are then separately compiled and placed into the war file by the individual
projects (e.g., aggregate-mysql). So if you do develop using these
maven-based projects within eclipse, you need to be sure that the
aggregate-src-latest.jar is being properly rebuilt (by the aggregate-src
project). I doubt on-the-fly editing will work like it does in the
eclipse-aggregate-gae project (and note that the maven-based gae build is
aggregate-gae, which mirrors the structures of aggregate-mysql and
aggregate-postgres).

Ah yes, I forgot about the JVM settings...

For Eclipse, you will want to edit the eclipse.ini file. This is in the
eclipse folder (where eclipse.exe is). When you run as a Web Applicaiton,
it starts 2 copies of all the code (one for the foreground web server, one
for the background server), and runs out of Perm space (code space).

I don't know what is required (the key values are definitely the
"XXMaxPermSize 512m" and the -Xmx1024m). I have:

-startup
plugins/org.eclipse.equinox.launcher_1.2.0.v20110502.jar
--launcher.library
plugins/org.eclipse.equinox.launcher.win32.win32.x86_64_1.1.100.v20110502
-product
org.eclipse.epp.package.jee.product
--launcher.defaultAction
openFile
--launcher.XXMaxPermSize
512M
-showsplash
org.eclipse.platform
--launcher.XXMaxPermSize
512m
--launcher.defaultAction
openFile
-vmargs
-Dosgi.requiredJavaVersion=1.5
-Xms100m
-Xmx1024m


Additional Eclipse configuration for Maven. On the Window / Preferences
page:

Java / Installed JREs:

Add the JDK path. (needed only for Maven-based builds)

Java / Installed JREs / Execution Environments:

Choose JavaSE-1.6, check the checkbox beside the JDK. (needed only for

Maven-based builds).

====> You will need to exit and restart Eclipse.


SYNC with the repository -- I have checked in new .classpath and .project
files for aggregate-mysql and aggregate-src (the project containing the
source files).

You will want the odk-mysql-it-settings, aggregate-src, aggregate-mysql
projects in your workspace.

With these changes, you can now "Run As -> maven install" to build the
aggregate-mysql project from within Eclipse (this will pop open Firefox and
run two trivial automated tests). Once that build is OK, you can then
Export WAR and it will export the same WAR structure as in the production
install.

The odk-mysql-it-settings-latest.jar is equivalent to the
ODKAggregate-settings.jar of the installer BUT has a login backdoor for the
testing -- the security.properties has:

security.server.superUserUsername=aggregate

Which allows the automated tests to log in with username aggregate,
password aggregate. You will want to either remove that jar and add in the
ODKAggregate-settings.jar produced from the standard install, or tweak the
build environment to alter the settings (which would break the automated
tests), or remember to change that user's password to something other than
'aggregate' in your production environment.

Mitch

Because of the Eclipse/Maven/GWT/AppEngine playing-well difficulties, I
now do development in Eclipse with the eclipse-aggregate-gae project
running as a GWT/AppEngine Web Application

On Tue, May 1, 2012 at 7:24 AM, Christopher Robert <chrislrobert@gmail.com wrote:

Hi Mitch,

Thanks for the quick and helpful reply. Your hints got me to the point
where I'm basically alive, but my build environment is still a bit less
than fully functional.

First, on the "mvn install", I always run out of memory on the gae
(BigTable) database unit test -- and then it skips everything from there.
Luckily, this is after the mysql build and test, but still I wonder if
there's an easy fix? I've included the relevant portion of the Maven output
after my signature below.

Second, after doing the mvn install I add the aggregate-mysql project to
Eclipse, as suggested by CONFIGURE.txt. If I try to build, I get a slew of
different errors. Some representative ones are below:

Maven error (1 of 1):

Plugin execution not covered by lifecycle configuration:
org.codehaus.mojo:build-helper-maven-plugin:1.7:add-source (execution:
add-java-source, phase: generate-sources) pom.xml /aggregate-mysql line 44 Maven
Project Build Lifecycle Mapping Problem

XML error (1 of 6):

cvc-complex-type.2.4.a: Invalid content was found starting with element
'url-pattern'. One of '{"http://java.sun.com/xml/ns/javaee":web-resource-name}'
is expected. web.xml
/aggregate-mysql/target/emma-it/aggregate-mysql-1.0/WEB-INF line 18 XML
Problem

JSP error (1 of 70 or so)

cal cannot be resolved to a type cal1.jsp
/aggregate-mysql/target/tomcat6x/apache-tomcat-6.0.35/apache-tomcat-6.0.35/webapps/examples/jsp/cal line
52 JSP Problem

HTML warnings (roughly 7,000)

My solution to these was to disable the Maven, Javascript Validator, and
Validator Builders for the project. Once I did that, I could build with
only warnings. Was that the correct approach?

However, if I build and export a WAR, the WAR isn't as complete as the WAR
output by the Maven build. In particular, it fails to include the
"aggregate-src-latest.jar" in WEB-INF/lib. In fact, the Eclipse-exported
WAR doesn't seem to actually include the Aggregate classes anywhere, unless
they're hidden some place that I haven't noticed. (Actually, it's not that
it's less complete, but rather than the Eclipse-generated WAR exports
different libraries. The WEB-INF/lib output by Maven includes 77 files,
including aggregate-src-latest.jar; the WEB-INF/lib output by Eclipse
includes 87 files, not including aggregate-src-latest.jar.)

This suggests to me that I might use Eclipse to develop and compile, but
that if I want to run/test I should hop into the command window to rebuild
with Maven. Is that what you guys do?

Thanks again, and sorry for the follow-up questions,

Chris

Maven build error (clip from end of output):

May 1, 2012 2:48:02 PM
org.opendatakit.common.persistence.engine.DatastoreAccessMetrics logUsage
INFO: opendatakit.MY_QRT_TABLE,0,0,0,0,0
May 1, 2012 2:48:02 PM
org.opendatakit.common.persistence.engine.DatastoreAccessMetrics logUsage
INFO:
opendatakit.__MY_NAMESPACE__ATTB_5FF06C41_F50B_4420_8B75_F2B2470BC98F,0,0,0,0,0
May 1, 2012 2:48:03 PM
org.opendatakit.common.persistence.engine.DatastoreAccessMetrics logUsage
INFO: opendatakit._MY_NAMESPACE

Mitch, thank you for getting back so quickly.

The information provided was helpful (for now & future reference), and I
will continue trying to learn more about how GAE compiling and automated
build/testing fits together and into Aggregate to get set up and enhance
the IT tests (using selenium), I hope.

I have switched the default compiler from J2SE1.6 to JDK7 (I hope to help
polish up the configure.txt file instructions with any potential future
merge requests offered further on); yet, after compiling with JDK7, I still
am getting issues, showing the cryptic 51.0 versioning complainthttp://pastebin.com/4q8gCcZ1using the setup environment as follows:

  • Java 7 (build 1.7.0_45-b18)
  • Eclipse 4.3.1 (Kepler),
  • appengine.eclipse.sdkbundle_1.8.9
  • com.google.gwt.eclipse.sdkbundle_2.6.0

I pulled all the files as instructed in readme.txt using maven (except the
jai-imageio-core possibly since I wasn't doing a deploy with tomcat-util)
and am still baffled by the 51.0 error

Also, FWIW all of the dependencies/versions used in my environment are
stated succinctly in the pastebin link just above.

I appreciate any help you might be able to provide getting my test
environment up and running.
Thanks, Chris

··· On Tuesday, February 18, 2014 1:04:03 AM UTC-5, Mitch wrote: > > The cryptic version error is complaining that you have Java 6 installed, > and the Google AppEngine SDK needs Java 7. > > I've never seen a command line length exceeded error during my builds on > Windows 7 64-bit. > > You also need to follow all the steps outlined in CONFIGURE.txt in the > root directory of the project. There are a lot of files you need to > manually add to Maven to get it to build. > > The code also requires Firefox ESR 17 for the integration tests. > > I have not had time to update the jars for the project. > > It would be *absolutely wonderful* if you added more IT tests using > Selenium. > > Mitch > > > > > On Sat, Feb 15, 2014 at 5:58 AM, Chris Cargile <follyb...@gmail.com wrote: > >> Hello ODKers, >> I'm trying to build the latest Aggregate on Windows 8/64-bit using native >> OS environment AND inside a VirtualBox VM created from Ubuntu 13.10-amd64 >> using mvn clean, install and/or Eclipse to experiment with and hopefully >> enhance unit/IT tests and test process automation, eventually. >> >> Before I get anywhere close to contributing back, I am hoping you would >> point me in the direction as to get beyond some build errors I've >> experienced: >> >> ---------------------- >> >> Using mvn install (after clean) on Win8 native environment using cygwin >> shell, I get: >> [ERROR] Failed to execute goal >> org.apache.maven.plugins:maven-compiler-plugin:3.0:compile >> (default-compile) on project aggregate-src: Compilation failure >> [ERROR] error: Exception thrown while constructing Processor object: >> com/google/appengine/tools/compilation/DatastoreCallbacksProcessor : >> Unsupported major.minor version 51.0 >> >> ----------------------- >> >> Using mvn install (after clean) on Windows 64-bit native environment, >> using COM shell, I get >> [ERROR] (log + comments ) >> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute >> goal org.codehaus.mojo:gwt-maven-plugin:2.5.1:compile (gwt-javascript) on >> project aggregate-src: >> >> I am thinking the above exception may be due to a limitation on >> command-line length limitations by the OS or .exe, as per the discussion >> matter, here >> . >> >> --------------------- >> >> Using Ubuntu VM inside Win8, I've realized the error: >> Failed to execute goal on project aggregate-gae:....artifact: ... >> aggregate-gae:src:latest ... could not be found >> >> >> >> Any help getting going with maven on the command line would be great for >> my learning maven and may lead to some exciting discovery about the >> advantages Win8 offers (we'll see how likely that it to be the case, right? >> :)) >> >> -- >> You received this message because you are subscribed to the Google Groups >> "ODK Developers" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to opendatakit-developers+unsubscribe@googlegroups.com >> . >> For more options, visit https://groups.google.com/groups/opt_out. >> > > > > -- > Mitch Sundt > Software Engineer > University of Washington > mitche...@gmail.com >

I was trying to say, IOW, all the dependencies in readme.txt are found in
/.m2/repository and recognized in the ODK mvn install build.

I am hoping you might help guide me beyond this small 'compile'-oriented
issue in my build process

··· On Friday, February 21, 2014 10:54:33 AM UTC-5, Chris Cargile wrote: > > Mitch, thank you for getting back so quickly. > > The information provided was helpful (for now & future reference), and I > will continue trying to learn more about how GAE compiling and automated > build/testing fits together and into Aggregate to get set up and enhance > the IT tests (using selenium), I hope. > > I have switched the default compiler from J2SE1.6 to JDK7 (I hope to help > polish up the configure.txt file instructions with any potential future > merge requests offered further on); yet, after compiling with JDK7, I still > am getting issues, showing the cryptic 51.0 versioning complaintusing the setup environment as follows: > > - Java 7 (build 1.7.0_45-b18) > - Eclipse 4.3.1 (Kepler), > - appengine.eclipse.sdkbundle_1.8.9 > - com.google.gwt.eclipse.sdkbundle_2.6.0 > > I pulled all the files as instructed in readme.txt using maven (except the > jai-imageio-core possibly since I wasn't doing a deploy with tomcat-util) > and am still baffled by the 51.0 error > > Also, FWIW all of the dependencies/versions used in my environment are > stated succinctly in the pastebin link just above. > > I appreciate any help you might be able to provide getting my test > environment up and running. > Thanks, Chris > > > > On Tuesday, February 18, 2014 1:04:03 AM UTC-5, Mitch wrote: >> >> The cryptic version error is complaining that you have Java 6 installed, >> and the Google AppEngine SDK needs Java 7. >> >> I've never seen a command line length exceeded error during my builds on >> Windows 7 64-bit. >> >> You also need to follow all the steps outlined in CONFIGURE.txt in the >> root directory of the project. There are a lot of files you need to >> manually add to Maven to get it to build. >> >> The code also requires Firefox ESR 17 for the integration tests. >> >> I have not had time to update the jars for the project. >> >> It would be *absolutely wonderful* if you added more IT tests using >> Selenium. >> >> Mitch >> >> >> >> >> On Sat, Feb 15, 2014 at 5:58 AM, Chris Cargile wrote: >> >>> Hello ODKers, >>> I'm trying to build the latest Aggregate on Windows 8/64-bit using >>> native OS environment AND inside a VirtualBox VM created from Ubuntu >>> 13.10-amd64 using mvn clean, install and/or Eclipse to experiment with and >>> hopefully enhance unit/IT tests and test process automation, eventually. >>> >>> Before I get anywhere close to contributing back, I am hoping you would >>> point me in the direction as to get beyond some build errors I've >>> experienced: >>> >>> ---------------------- >>> >>> Using mvn install (after clean) on Win8 native environment using cygwin >>> shell, I get: >>> [ERROR] Failed to execute goal >>> org.apache.maven.plugins:maven-compiler-plugin:3.0:compile >>> (default-compile) on project aggregate-src: Compilation failure >>> [ERROR] error: Exception thrown while constructing Processor object: >>> com/google/appengine/tools/compilation/DatastoreCallbacksProcessor : >>> Unsupported major.minor version 51.0 >>> >>> ----------------------- >>> >>> Using mvn install (after clean) on Windows 64-bit native environment, >>> using COM shell, I get >>> [ERROR] (log + comments ) >>> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to >>> execute goal org.codehaus.mojo:gwt-maven-plugin:2.5.1:compile >>> (gwt-javascript) on project aggregate-src: >>> >>> I am thinking the above exception may be due to a limitation on >>> command-line length limitations by the OS or .exe, as per the >>> discussion matter, here >>> . >>> >>> --------------------- >>> >>> Using Ubuntu VM inside Win8, I've realized the error: >>> Failed to execute goal on project aggregate-gae:....artifact: ... >>> aggregate-gae:src:latest ... could not be found >>> >>> >>> >>> Any help getting going with maven on the command line would be great for >>> my learning maven and may lead to some exciting discovery about the >>> advantages Win8 offers (we'll see how likely that it to be the case, right? >>> :)) >>> >>> -- >>> You received this message because you are subscribed to the Google >>> Groups "ODK Developers" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to opendatakit-developers+unsubscribe@googlegroups.com. >>> For more options, visit https://groups.google.com/groups/opt_out. >>> >> >> >> >> -- >> Mitch Sundt >> Software Engineer >> University of Washington >> mitche...@gmail.com >> >

Are you on a Mac or Windows?

If you open a terminal window and type

java -version

What does it report?

··· On Fri, Feb 21, 2014 at 8:13 AM, Chris Cargile wrote:

I was trying to say, IOW, all the dependencies in readme.txt are found in
/.m2/repository and recognized in the ODK mvn install build.

I am hoping you might help guide me beyond this small 'compile'-oriented
issue in my build process

On Friday, February 21, 2014 10:54:33 AM UTC-5, Chris Cargile wrote:

Mitch, thank you for getting back so quickly.

The information provided was helpful (for now & future reference), and I
will continue trying to learn more about how GAE compiling and automated
build/testing fits together and into Aggregate to get set up and enhance
the IT tests (using selenium), I hope.

I have switched the default compiler from J2SE1.6 to JDK7 (I hope to
help polish up the configure.txt file instructions with any potential
future merge requests offered further on); yet, after compiling with JDK7,
I still am getting issues, showing the cryptic 51.0 versioning complainthttp://pastebin.com/4q8gCcZ1using the setup environment as follows:

  • Java 7 (build 1.7.0_45-b18)
  • Eclipse 4.3.1 (Kepler),
  • appengine.eclipse.sdkbundle_1.8.9
  • com.google.gwt.eclipse.sdkbundle_2.6.0

I pulled all the files as instructed in readme.txt using maven (except
the jai-imageio-core possibly since I wasn't doing a deploy with
tomcat-util) and am still baffled by the 51.0 error

Also, FWIW all of the dependencies/versions used in my environment are
stated succinctly in the pastebin link just above.

I appreciate any help you might be able to provide getting my test
environment up and running.
Thanks, Chris

On Tuesday, February 18, 2014 1:04:03 AM UTC-5, Mitch wrote:

The cryptic version error is complaining that you have Java 6 installed,
and the Google AppEngine SDK needs Java 7.

I've never seen a command line length exceeded error during my builds on
Windows 7 64-bit.

You also need to follow all the steps outlined in CONFIGURE.txt in the
root directory of the project. There are a lot of files you need to
manually add to Maven to get it to build.

The code also requires Firefox ESR 17 for the integration tests.

I have not had time to update the jars for the project.

It would be absolutely wonderful if you added more IT tests using
Selenium.

Mitch

On Sat, Feb 15, 2014 at 5:58 AM, Chris Cargile follyb...@gmail.comwrote:

Hello ODKers,
I'm trying to build the latest Aggregate on Windows 8/64-bit using
native OS environment AND inside a VirtualBox VM created from Ubuntu
13.10-amd64 using mvn clean, install and/or Eclipse to experiment with and
hopefully enhance unit/IT tests and test process automation, eventually.

Before I get anywhere close to contributing back, I am hoping you would
point me in the direction as to get beyond some build errors I've
experienced:


Using mvn install (after clean) on Win8 native environment using cygwin
shell, I get:
[ERROR] Failed to execute goal org.apache.maven.plugins:
maven-compiler-plugin:3.0:compile (default-compile) on project
aggregate-src: Compilation failure
[ERROR] error: Exception thrown while constructing Processor object:
com/google/appengine/tools/compilation/DatastoreCallbacksProcessor :
Unsupported major.minor version 51.0


Using mvn install (after clean) on Windows 64-bit native environment,
using COM shell, http://goo.gl/fTtWZ7I get
[ERROR] (log + comments http://goo.gl/fTtWZ7)
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to
execute goal org.codehaus.mojo:gwt-maven-plugin:2.5.1:compile
(gwt-javascript) on project aggregate-src:

I am thinking the above exception may be due to a limitation on
command-line length limitations by the OS or .exe, as per the
discussion matter, herehttp://mojo.10943.n7.nabble.com/Mysterious-error-during-gwt-compile-td37646.html
.


Using Ubuntu VM inside Win8, I've realized the error:
Failed to execute goal on project aggregate-gae:....artifact: ...
aggregate-gae:src:latest ... could not be found

Any help getting going with maven on the command line would be great
for my learning maven and may lead to some exciting discovery about the
advantages Win8 offers (we'll see how likely that it to be the case, right?
:))

--
You received this message because you are subscribed to the Google
Groups "ODK Developers" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to opendatakit-developers+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
Mitch Sundt
Software Engineer
University of Washington
mitche...@gmail.com

--
You received this message because you are subscribed to the Google Groups
"ODK Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit-developers+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com

I am using a machine with Windows 8. The output from java is:

java version "1.7.0_45"
Java(TM) SE Runtime Environment (build 1.7.0_45-b18)
Java HotSpot(TM) 64-Bit Server VM (build 24.45-b08, mixed mode)

··· On Friday, February 21, 2014 6:52:45 PM UTC-5, Mitch wrote: > > Are you on a Mac or Windows? > > If you open a terminal window and type > > java -version > > What does it report? > > > > > On Fri, Feb 21, 2014 at 8:13 AM, Chris Cargile <follyb...@gmail.com wrote: > >> I was trying to say, IOW, all the dependencies in readme.txt are found in >> /.m2/repository and recognized in the ODK mvn install build. >> >> I am hoping you might help guide me beyond this small 'compile'-oriented >> issue in my build process >> >> >> >> On Friday, February 21, 2014 10:54:33 AM UTC-5, Chris Cargile wrote: >>> >>> Mitch, thank you for getting back so quickly. >>> >>> The information provided was helpful (for now & future reference), and I >>> will continue trying to learn more about how GAE compiling and automated >>> build/testing fits together and into Aggregate to get set up and enhance >>> the IT tests (using selenium), I hope. >>> >>> I have switched the default compiler from J2SE1.6 to JDK7 (I hope to >>> help polish up the configure.txt file instructions with any potential >>> future merge requests offered further on); yet, after compiling with JDK7, >>> I still am getting issues, showing the cryptic 51.0 versioning complaintusing the setup environment as follows: >>> >>> - Java 7 (build 1.7.0_45-b18) >>> - Eclipse 4.3.1 (Kepler), >>> - appengine.eclipse.sdkbundle_1.8.9 >>> - com.google.gwt.eclipse.sdkbundle_2.6.0 >>> >>> I pulled all the files as instructed in readme.txt using maven (except >>> the jai-imageio-core possibly since I wasn't doing a deploy with >>> tomcat-util) and am still baffled by the 51.0 error >>> >>> Also, FWIW all of the dependencies/versions used in my environment are >>> stated succinctly in the pastebin link just above. >>> >>> I appreciate any help you might be able to provide getting my test >>> environment up and running. >>> Thanks, Chris >>> >>> >>> >>> On Tuesday, February 18, 2014 1:04:03 AM UTC-5, Mitch wrote: >>>> >>>> The cryptic version error is complaining that you have Java 6 >>>> installed, and the Google AppEngine SDK needs Java 7. >>>> >>>> I've never seen a command line length exceeded error during my builds >>>> on Windows 7 64-bit. >>>> >>>> You also need to follow all the steps outlined in CONFIGURE.txt in the >>>> root directory of the project. There are a lot of files you need to >>>> manually add to Maven to get it to build. >>>> >>>> The code also requires Firefox ESR 17 for the integration tests. >>>> >>>> I have not had time to update the jars for the project. >>>> >>>> It would be *absolutely wonderful* if you added more IT tests using >>>> Selenium. >>>> >>>> Mitch >>>> >>>> >>>> >>>> >>>> On Sat, Feb 15, 2014 at 5:58 AM, Chris Cargile wrote: >>>> >>>>> Hello ODKers, >>>>> I'm trying to build the latest Aggregate on Windows 8/64-bit using >>>>> native OS environment AND inside a VirtualBox VM created from Ubuntu >>>>> 13.10-amd64 using mvn clean, install and/or Eclipse to experiment with and >>>>> hopefully enhance unit/IT tests and test process automation, eventually. >>>>> >>>>> Before I get anywhere close to contributing back, I am hoping you >>>>> would point me in the direction as to get beyond some build errors I've >>>>> experienced: >>>>> >>>>> ---------------------- >>>>> >>>>> Using mvn install (after clean) on Win8 native environment using >>>>> cygwin shell, I get: >>>>> [ERROR] Failed to execute goal org.apache.maven.plugins: >>>>> maven-compiler-plugin:3.0:compile (default-compile) on project >>>>> aggregate-src: Compilation failure >>>>> [ERROR] error: Exception thrown while constructing Processor object: >>>>> com/google/appengine/tools/compilation/DatastoreCallbacksProcessor : >>>>> Unsupported major.minor version 51.0 >>>>> >>>>> ----------------------- >>>>> >>>>> Using mvn install (after clean) on Windows 64-bit native environment, >>>>> using COM shell, I get >>>>> [ERROR] (log + comments ) >>>>> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to >>>>> execute goal org.codehaus.mojo:gwt-maven-plugin:2.5.1:compile >>>>> (gwt-javascript) on project aggregate-src: >>>>> >>>>> I am thinking the above exception may be due to a limitation on >>>>> command-line length limitations by the OS or .exe, as per the >>>>> discussion matter, here >>>>> . >>>>> >>>>> --------------------- >>>>> >>>>> Using Ubuntu VM inside Win8, I've realized the error: >>>>> Failed to execute goal on project aggregate-gae:....artifact: ... >>>>> aggregate-gae:src:latest ... could not be found >>>>> >>>>> >>>>> >>>>> Any help getting going with maven on the command line would be great >>>>> for my learning maven and may lead to some exciting discovery about the >>>>> advantages Win8 offers (we'll see how likely that it to be the case, right? >>>>> :)) >>>>> >>>>> -- >>>>> You received this message because you are subscribed to the Google >>>>> Groups "ODK Developers" group. >>>>> To unsubscribe from this group and stop receiving emails from it, send >>>>> an email to opendatakit-developers+unsubscribe@googlegroups.com. >>>>> For more options, visit https://groups.google.com/groups/opt_out. >>>>> >>>> >>>> >>>> >>>> -- >>>> Mitch Sundt >>>> Software Engineer >>>> University of Washington >>>> mitche...@gmail.com >>>> >>> -- >> You received this message because you are subscribed to the Google Groups >> "ODK Developers" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to opendatakit-developers+unsubscribe@googlegroups.com >> . >> For more options, visit https://groups.google.com/groups/opt_out. >> > > > > -- > Mitch Sundt > Software Engineer > University of Washington > mitche...@gmail.com >

I suspect there is an issue with GWT 2.6 the original pom.xml uses GWT 2.5.1

Are you changing the pom.xml to update those values? If you are, I cannot
help you. Get the build to work first with the standard POM, then you can
try tweaking to these newer releases on your own.

My .m2/settings is:




local.gae
mitchellsundt@gmail.com





gae
true

${user.home}/.m2/repository

<temp.home>C:\Users\Administrator\AppData\Local\Temp</temp.home>

<gae.home>\C:\Users\Administrator\appengine-java-sdk-1.8.0</gae.home>
<bitrock.home>C:\Program Files (x86)\BitRock InstallBuilder
Professional 8.5.1</bitrock.home>

<keystore.propertyfile>\C:\Users\Administrator\keystore\jarSignerDetails.txt</keystore.propertyfile>
<headless.operation>no</headless.operation>
<mysql.client.executable>C:\Program Files\MySQL\MySQL Server
5.5\bin\mysql.exe</mysql.client.executable>
<mysql.root.password>zzzzzzzzzzzzzzzzzzzzzzzz</mysql.root.password>
<postgres.client.executable>C:\Program
Files\PostgreSQL\9.1\bin\psql.exe</postgres.client.executable>

<postgres.root.password>zzzzzzzzzzzzzzzzzzzzzzz</postgres.root.password>

<selenium.home>C:\Users\Administrator\Documents\selenium\selenium-2.33.0</selenium.home>

<selenium.libs>C:\Users\Administrator\Documents\selenium\selenium-2.33.0\libs</selenium.libs>

<test.server.hostname>zzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzz</test.server.hostname>
<test.server.port>7070</test.server.port>
<test.server.secure.port>7443</test.server.secure.port>
<test.server.gae.monitor.port>7075</test.server.gae.monitor.port>
<firefox.executable></firefox.executable>

<catalina.zip>file:///C:\Users\Administrator\.m2\apache-tomcat-6.0.35-windows-x64.zip</catalina.zip>



The corresponding output from my build is:

[INFO] --- gwt-maven-plugin:2.5.1:compile (gwt-javascript) @ aggregate-src

··· --- [INFO] auto discovered modules [org.opendatakit.aggregate.AggregateUI, org.opendatakit.common.web.Web, org.opendatakit.common.security.Security, org.opendatakit.common.persist ence.Persistence] [INFO] org.opendatakit.common.web.Web has no EntryPoint - compilation skipped [INFO] org.opendatakit.common.security.Security has no EntryPoint - compilation skipped [INFO] org.opendatakit.common.persistence.Persistence has no EntryPoint - compilation skipped [INFO] Compiling module org.opendatakit.aggregate.AggregateUI [INFO] Validating units: [INFO] Ignored 80 units with compilation errors in first pass. [INFO] Compile with -strict or with -logLevel set to TRACE or DEBUG to see all errors. [INFO] Computing all possible rebind results for 'com.google.gwt.useragent.client.UserAgentAsserter' [INFO] Rebinding com.google.gwt.useragent.client.UserAgentAsserter [INFO] Checking rule [INFO] [WARN] Detected warnings related to 'com.google.gwt.editor.client.SimpleBeanEditorDriver'. Are validation-api-.jar and validation-api--s ources.jar on the classpath? [INFO] Specify -logLevel DEBUG to see all errors. [INFO] [WARN] Unknown type 'com.google.gwt.editor.client.SimpleBeanEditorDriver' specified in deferred binding rule [INFO] Compiling 6 permutations [INFO] Compiling permutation 3... [INFO] Process output [INFO] Compiling [INFO] Compiling permutation 2... [INFO] Process output [INFO] Compiling [INFO] Compiling permutation 5... [INFO] Process output [INFO] Compiling [INFO] Compiling permutation 0... [INFO] Process output [INFO] Compiling [INFO] Compiling permutation 4... [INFO] Process output [INFO] Compiling [INFO] Compiling permutation 1...

On Sat, Feb 22, 2014 at 10:49 AM, Chris Cargile follybeachris@gmail.comwrote:

I am using a machine with Windows 8. The output from java is:

java version "1.7.0_45"
Java(TM) SE Runtime Environment (build 1.7.0_45-b18)
Java HotSpot(TM) 64-Bit Server VM (build 24.45-b08, mixed mode)

On Friday, February 21, 2014 6:52:45 PM UTC-5, Mitch wrote:

Are you on a Mac or Windows?

If you open a terminal window and type

java -version

What does it report?

On Fri, Feb 21, 2014 at 8:13 AM, Chris Cargile follyb...@gmail.comwrote:

I was trying to say, IOW, all the dependencies in readme.txt are found
in /.m2/repository and recognized in the ODK mvn install build.

I am hoping you might help guide me beyond this small 'compile'-oriented
issue in my build process

On Friday, February 21, 2014 10:54:33 AM UTC-5, Chris Cargile wrote:

Mitch, thank you for getting back so quickly.

The information provided was helpful (for now & future reference), and
I will continue trying to learn more about how GAE compiling and automated
build/testing fits together and into Aggregate to get set up and enhance
the IT tests (using selenium), I hope.

I have switched the default compiler from J2SE1.6 to JDK7 (I hope to
help polish up the configure.txt file instructions with any potential
future merge requests offered further on); yet, after compiling with JDK7,
I still am getting issues, showing the cryptic 51.0 versioning
complaint http://pastebin.com/4q8gCcZ1 using the setup environment
as follows:

  • Java 7 (build 1.7.0_45-b18)
  • Eclipse 4.3.1 (Kepler),
  • appengine.eclipse.sdkbundle_1.8.9
  • com.google.gwt.eclipse.sdkbundle_2.6.0

I pulled all the files as instructed in readme.txt using maven (except
the jai-imageio-core possibly since I wasn't doing a deploy with
tomcat-util) and am still baffled by the 51.0 error

Also, FWIW all of the dependencies/versions used in my environment are
stated succinctly in the pastebin link just above.

I appreciate any help you might be able to provide getting my test
environment up and running.
Thanks, Chris

On Tuesday, February 18, 2014 1:04:03 AM UTC-5, Mitch wrote:

The cryptic version error is complaining that you have Java 6
installed, and the Google AppEngine SDK needs Java 7.

I've never seen a command line length exceeded error during my builds
on Windows 7 64-bit.

You also need to follow all the steps outlined in CONFIGURE.txt in the
root directory of the project. There are a lot of files you need to
manually add to Maven to get it to build.

The code also requires Firefox ESR 17 for the integration tests.

I have not had time to update the jars for the project.

It would be absolutely wonderful if you added more IT tests using
Selenium.

Mitch

On Sat, Feb 15, 2014 at 5:58 AM, Chris Cargile follyb...@gmail.comwrote:

Hello ODKers,
I'm trying to build the latest Aggregate on Windows 8/64-bit using
native OS environment AND inside a VirtualBox VM created from Ubuntu
13.10-amd64 using mvn clean, install and/or Eclipse to experiment with and
hopefully enhance unit/IT tests and test process automation, eventually.

Before I get anywhere close to contributing back, I am hoping you
would point me in the direction as to get beyond some build errors I've
experienced:


Using mvn install (after clean) on Win8 native environment using
cygwin shell, I get:
[ERROR] Failed to execute goal org.apache.maven.plugins:maven
-compiler-plugin:3.0:compile (default-compile) on project
aggregate-src: Compilation failure
[ERROR] error: Exception thrown while constructing Processor object:
com/google/appengine/tools/compilation/DatastoreCallbacksProcessor :
Unsupported major.minor version 51.0


Using mvn install (after clean) on Windows 64-bit native environment,
using COM shell, http://goo.gl/fTtWZ7I get
[ERROR] (log + comments http://goo.gl/fTtWZ7)
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to
execute goal org.codehaus.mojo:gwt-maven-plugin:2.5.1:compile
(gwt-javascript) on project aggregate-src:

I am thinking the above exception may be due to a limitation on
command-line length limitations by the OS or .exe, as per the
discussion matter, herehttp://mojo.10943.n7.nabble.com/Mysterious-error-during-gwt-compile-td37646.html
.


Using Ubuntu VM inside Win8, I've realized the error:
Failed to execute goal on project aggregate-gae:....artifact: ...
aggregate-gae:src:latest ... could not be found

Any help getting going with maven on the command line would be great
for my learning maven and may lead to some exciting discovery about the
advantages Win8 offers (we'll see how likely that it to be the case, right?
:))

--
You received this message because you are subscribed to the Google
Groups "ODK Developers" group.
To unsubscribe from this group and stop receiving emails from it,
send an email to opendatakit-developers+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
Mitch Sundt
Software Engineer
University of Washington
mitche...@gmail.com

--
You received this message because you are subscribed to the Google
Groups "ODK Developers" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to opendatakit-developers+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
Mitch Sundt
Software Engineer
University of Washington
mitche...@gmail.com

--
You received this message because you are subscribed to the Google Groups
"ODK Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit-developers+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com