scala - Prediction.io training unresponsive -
i using similarproduct template of prediction.io inserted 16 thousand products, 70 thousand users , 1.6 million view events.
pio build done in pio train goes unresponsive @ stage 13 since have tried 3 times @ waited 6 7 hours stuck @ stage 13 below logs
[info] [console$] using existing engine manifest json @ /home/dau/predictionio/similar_product/manifest.json [info] [runner$] submission command: /home/dau/predictionio/vendors/spark-1.6.0/bin/spark-submit --class io.prediction.workflow.createworkflow --jars file:/home/dau/predictionio/similar_product/target/scala-2.10/template-scala-parallel-similarproduct-assembly-0.1-snapshot-deps.jar,file:/home/dau/predictionio/similar_product/target/scala-2.10/template-scala-parallel-similarproduct_2.10-0.1-snapshot.jar --files file:/home/dau/predictionio/conf/log4j.properties,file:/home/dau/predictionio/vendors/hbase-1.1.2/conf/hbase-site.xml --driver-class-path /home/dau/predictionio/conf:/home/dau/predictionio/lib/postgresql-9.4-1204.jdbc41.jar:/home/dau/predictionio/lib/mysql-connector-java-5.1.37.jar:/home/dau/predictionio/vendors/hbase-1.1.2/conf file:/home/dau/predictionio/lib/pio-assembly-0.9.6.jar --engine-id tvpk9sthw8hjh6lyz0prqtcb6iizolsf --engine-version 9c974b7a0cc9a0a9c97387bbacb6486db3ebb738 --engine-variant file:/home/dau/predictionio/similar_product/engine.json --verbosity 0 --json-extractor both --env pio_storage_sources_hbase_type=hbase,pio_env_loaded=1,pio_storage_repositories_metadata_name=pio_meta,pio_fs_basedir=/home/dau/.pio_store,pio_storage_sources_hbase_home=/home/dau/predictionio/vendors/hbase-1.1.2,pio_home=/home/dau/predictionio,pio_fs_enginesdir=/home/dau/.pio_store/engines,pio_storage_sources_localfs_path=/home/dau/.pio_store/models,pio_storage_sources_elasticsearch_type=elasticsearch,pio_storage_repositories_metadata_source=elasticsearch,pio_storage_repositories_modeldata_source=localfs,pio_storage_repositories_eventdata_name=pio_event,pio_storage_sources_elasticsearch_home=/home/dau/predictionio/vendors/elasticsearch-1.7.3,pio_fs_tmpdir=/home/dau/.pio_store/tmp,pio_storage_repositories_modeldata_name=pio_model,pio_storage_repositories_eventdata_source=hbase,pio_conf_dir=/home/dau/predictionio/conf,pio_storage_sources_localfs_type=localfs [info] [engine] extracting datasource params... [info] [workflowutils$] no 'name' found. default empty string used. [info] [engine] datasource params: (,datasourceparams(rw_store)) [info] [engine] extracting preparator params... [info] [engine] preparator params: (,empty) [info] [engine] extracting serving params... [info] [engine] serving params: (,empty) [warn] [utils] hostname, dau-lap resolves loopback address: 127.0.1.1; using 192.168.43.91 instead (on interface wlan0) [warn] [utils] set spark_local_ip if need bind address [info] [remoting] starting remoting [info] [remoting] remoting started; listening on addresses :[akka.tcp://sparkdriveractorsystem@192.168.43.91:40349] [info] [engine$] engineworkflow.train [info] [engine$] datasource: com.company.datasource@7cfb8e98 [info] [engine$] preparator: com.company.preparator@1ec88aa1 [info] [engine$] algorithmlist: list(com.company.alsalgorithm@3030836d) [info] [engine$] data sanity check on. [warn] [tableinputformatbase] cannot resolve host name dau-lap/127.0.1.1 because of javax.naming.namenotfoundexception: dns name not found [response code 3]; remaining name '1.1.0.127.in-addr.arpa' [warn] [tableinputformatbase] cannot resolve host name dau-lap/127.0.1.1 because of javax.naming.namenotfoundexception: dns name not found [response code 3]; remaining name '1.1.0.127.in-addr.arpa' [warn] [tableinputformatbase] cannot resolve host name dau-lap/127.0.1.1 because of javax.naming.namenotfoundexception: dns name not found [response code 3]; remaining name '1.1.0.127.in-addr.arpa' [warn] [tableinputformatbase] cannot resolve host name dau-lap/127.0.1.1 because of javax.naming.namenotfoundexception: dns name not found [response code 3]; remaining name '1.1.0.127.in-addr.arpa' [info] [engine$] com.company.trainingdata not support data sanity check. skipping check. [info] [engine$] com.company.prepareddata not support data sanity check. skipping check. [warn] [tableinputformatbase] cannot resolve host name dau-lap/127.0.1.1 because of javax.naming.namenotfoundexception: dns name not found [response code 3]; remaining name '1.1.0.127.in-addr.arpa' [warn] [tableinputformatbase] cannot resolve host name dau-lap/127.0.1.1 because of javax.naming.namenotfoundexception: dns name not found [response code 3]; remaining name '1.1.0.127.in-addr.arpa' [info] [alsalgorithm] couldn't convert nonexistent item id 513 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 513 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 0 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 513 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 513 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 513 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 513 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 513 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 513 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 513 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 513 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 513 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 513 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 513 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 513 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 513 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 513 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 513 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 513 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 513 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 513 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 513 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 513 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 513 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 513 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 513 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 3055 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 3055 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 3055 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 513 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 513 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 513 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 513 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 222 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 222 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 416 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 0 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 513 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 513 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 513 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 513 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 513 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 513 int index. [stage 13:> (0 + 1) / 2][info] [alsalgorithm] couldn't convert nonexistent item id 0 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 484 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 513 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 513 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 222 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 414 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 513 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 513 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 513 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 513 int index. [info] [alsalgorithm] couldn't convert nonexistent item id 513 int index. [stage 13:=============================> (1 + 0) / 2] here engine.json
{ "id": "default", "description": "default settings", "enginefactory": "com.company.similarproductengine", "datasource": { "params" : { "appname": "store" } }, "algorithms": [ { "name": "als", "params": { "rank": 10, "numiterations" : 20, "lambda": 0.01, "seed": 3 } } ] }
Comments
Post a Comment