dcsimg

Import Log for Global Biotic Interactions

  • Started: June 03, 2022 15:26
  • Completed: 15:56:55
  • Failed: No.
  • Status: completed

Events (most recent first):

  • 16:35:34 (infos) ++ NUKE: Medium (0)
  • 16:35:34 (infos) Removed 0 Identifiers
  • 16:35:34 (infos) ++ Calling delete_all on 0 instances...
  • 16:35:34 (infos) ++ NUKE: Identifier (0)
  • 16:35:34 (infos) Removed 2038653 Nodeancestors
  • 16:32:34 (updates) Batch 203 (expect 204 batches, maximum 408)...
  • 16:32:34 (infos) Starting (this log message should be replaced shortly)
  • 16:32:34 (infos) ++ Batch removal of 2038653 instances...
  • 16:32:34 (infos) ++ NUKE: NodeAncestor (2038653)
  • 15:56:55 (ends) Complete
  • 15:56:55 (ends) TOTAL TIME: 30.0m
  • 15:56:55 (starts) TraitBank::Denormalizer.update_resource_vernaculars
  • 15:56:55 (starts) Running
  • 15:56:48 (starts) Resource#fix_native_nodes
  • 15:56:48 (starts) Running
  • 15:56:48 (warns) Trait Publishing failed: The transaction has been terminated. Retry your operation in a new transaction, and you should see a successful result. The transaction has not completed within the specified timeout (dbms.transaction.timeout). You may want to retry with a longer timeout. FROM /usr/local/bundle/bundler/gems/neo4j-ruby-driver-fe5438fb945d/ffi/neo4j/driver/internal/handlers/response_handler.rb:38:in `check_summary_failure' << /app/lib/trait_bank/slurp.rb:562:in `merge_triple' << /app/lib/trait_bank/slurp.rb:447:in `block in load_csv_where' << /app/lib/trait_bank/slurp.rb:447:in `each' << /app/lib/trait_bank/slurp.rb:447:in `load_csv_where' << /app/lib/trait_bank/slurp.rb:331:in `block (2 levels) in load_csv'
  • 15:56:48 (warns) Exception (Neo4j::Driver::Exceptions::ClientException) FROM: #merge_triple QUERY: {USING PERIODIC COMMIT LOAD CSV WITH HEADERS FROM 'https://eol.org/data/Globi/publish_traits_chunk_2.csv' AS row WITH row WHERE (row.object_page_id IS NOT NULL AND TRIM(row.object_page_id) <> '') MATCH (trait:Trait { eol_pk: row.eol_pk }) MATCH (object_page:Page { page_id: toInteger(row.object_page_id) })}
  • 15:56:48 (warns) Exception (Neo4j::Driver::Exceptions::ClientException) QUERY: {USING PERIODIC COMMIT LOAD CSV WITH HEADERS FROM 'https://eol.org/data/Globi/publish_traits_chunk_2.csv' AS row WITH row WHERE (row.object_page_id IS NOT NULL AND TRIM(row.object_page_id) <> '') MATCH (trait:Trait { eol_pk: row.eol_pk }) MATCH (object_page:Page { page_id: toInteger(row.object_page_id) }) MERGE (trait)-[:object_page]->(object_page)} MESSAGE: The transaction has been terminated. Retry your operation in a new transaction, and you should see a successful result. The transaction has not completed within the specified timeout (dbms.transaction.timeout). You may want to retry with a longer timeout.
  • 15:54:25 (infos) Importing 128000 rows from publish_traits_chunk_2.csv
  • 15:49:24 (infos) Waiting 300 seconds for the last 'chunk' to be added to neo4j...
  • 15:48:08 (infos) Importing 128000 rows from publish_traits_chunk_1.csv
  • 15:48:07 (warns) Found 5552474 rows, will break up into 128000
  • 15:48:02 (infos) adding new traits
  • 15:39:51 (infos) removing all traits
  • 15:39:21 (infos) Connecting to https://content.eol.org/ ...
  • 15:38:42 (infos) Connecting to https://content.eol.org/ ...
  • 15:38:40 (infos) polling for trait diff metadata: /resources/20/publish_diffs.json
  • 15:38:40 (starts) #publish_traits = TraitBank::Slurp.load_resource_from_repo
  • 15:38:40 (starts) Running
  • 15:38:40 (warns) There were NO new pages, skipping...
  • 15:37:51 (starts) create_new_pages
  • 15:37:48 (starts) PageCreator
  • 15:37:48 (starts) Running
  • 15:37:48 (starts) restoring vernacular preferences...
  • 15:37:48 (starts) Running
  • 15:37:48 (warns) MISSING https://content.eol.org/data/Globi/publish_content_sections.tsv [404] (8 bytes); skipping
  • 15:37:48 (infos) Connecting to https://content.eol.org/ ...
  • 15:37:48 (starts) #grab_file content_sections.tsv
  • 15:37:48 (starts) Running
  • 15:37:48 (starts) #import_and_prop_ids ContentSection
  • 15:37:48 (starts) Running
  • 15:37:48 (warns) MISSING https://content.eol.org/data/Globi/publish_references.tsv [404] (8 bytes); skipping
  • 15:37:48 (infos) Connecting to https://content.eol.org/ ...
  • 15:37:48 (starts) #grab_file references.tsv
  • 15:37:48 (starts) Running
  • 15:37:48 (starts) #import_and_prop_ids Reference
  • 15:37:48 (starts) Running
  • 15:37:48 (warns) MISSING https://content.eol.org/data/Globi/publish_image_info.tsv [404] (8 bytes); skipping
  • 15:37:48 (infos) Connecting to https://content.eol.org/ ...
  • 15:37:48 (starts) #grab_file image_info.tsv