dcsimg

Import Log for Global Biotic Interactions

  • Started: April 11, 2024 13:36
  • Completed: 18:31:50
  • Failed: No.
  • Status: completed

Events (most recent first):

  • 10:31:58 (infos) Importing 128000 rows from publish_metadata_chunk_3.csv
  • 10:25:55 (infos) Waiting 6 minutes for the last 'chunk' to be added to neo4j...
  • 10:25:28 (infos) Importing 128000 rows from publish_metadata_chunk_2.csv
  • 10:21:26 (infos) Waiting 4 minutes for the last 'chunk' to be added to neo4j...
  • 10:20:59 (infos) Importing 128000 rows from publish_metadata_chunk_1.csv
  • 10:20:58 (warns) Found 2980195 rows, will break up into 128000
  • 10:20:56 (infos) adding new metadata
  • 10:20:53 (infos) Importing 128000 rows from publish_traits_1676047141.tsv
  • 10:20:53 (infos) adding new traits
  • 10:20:53 (infos) not removing any traits
  • 10:20:14 (infos) Connecting to https://content.eol.org/ ...
  • 10:20:14 (infos) /data/Globi/publish_traits_1676047141.tsv: Scheme missing.
  • 10:20:13 (warns) USING wget TO RETRIEVE FULL FILE...
  • 10:20:13 (warns) TRUNCATED RESPONSE! Got 581192727 bytes out of 798115280 from https://content.eol.org/data/Globi/publish_traits_1676047141.tsv
  • 10:19:56 (infos) Connecting to https://content.eol.org/ ...
  • 10:19:56 (infos) polling for trait diff metadata: /resources/20/publish_diffs.json?since=1712827333
  • 10:19:56 (starts) #publish_traits = TraitBank::Slurp.load_resource_from_repo
  • 10:19:56 (starts) Running
  • 10:16:58 (starts) There is no (remaining) trait content for [Global Biotic Interactions](https://eol.org/resources/396), job complete.
  • 10:11:40 (starts) Removing trait content for [Global Biotic Interactions](https://eol.org/resources/396)...
  • 20:16:39 (ends) Complete
  • 20:16:39 (ends) TOTAL TIME: 2.5h
  • 20:16:39 (warns) Trait Publishing failed: Couldn't load the external resource at: https://eol.org/data/Globi/publish_traits_1676047141_chunk_11.csv FROM /gems/ruby/2.7.0/bundler/gems/neo4j-ruby-driver-fe5438fb945d/ffi/neo4j/driver/internal/handlers/response_handler.rb:38:in `check_summary_failure' << /app/lib/trait_bank/slurp.rb:555:in `merge_triple' << /app/lib/trait_bank/slurp.rb:440:in `block in load_csv_where' << /app/lib/trait_bank/slurp.rb:440:in `each' << /app/lib/trait_bank/slurp.rb:440:in `load_csv_where' << /app/lib/trait_bank/slurp.rb:327:in `block (2 levels) in load_csv'
  • 20:16:39 (warns) Exception (Neo4j::Driver::Exceptions::ClientException) FROM: #merge_triple QUERY: {USING PERIODIC COMMIT LOAD CSV WITH HEADERS FROM 'https://eol.org/data/Globi/publish_traits_1676047141_chunk_11.csv' AS row WITH row WHERE (row.determined_by_uri IS NOT NULL AND TRIM(row.determined_by_uri) <> '') MATCH (trait:Trait { eol_pk: row.eol_pk }) MATCH (determined_by:Term { uri: row.determined_by_uri })}
  • 20:16:39 (warns) Exception (Neo4j::Driver::Exceptions::ClientException) QUERY: {USING PERIODIC COMMIT LOAD CSV WITH HEADERS FROM 'https://eol.org/data/Globi/publish_traits_1676047141_chunk_11.csv' AS row WITH row WHERE (row.determined_by_uri IS NOT NULL AND TRIM(row.determined_by_uri) <> '') MATCH (trait:Trait { eol_pk: row.eol_pk }) MATCH (determined_by:Term { uri: row.determined_by_uri }) MERGE (trait)-[:determined_by]->(determined_by)} MESSAGE: Couldn't load the external resource at: https://eol.org/data/Globi/publish_traits_1676047141_chunk_11.csv
  • 20:15:17 (infos) Importing 128000 rows from publish_traits_1676047141_chunk_11.csv
  • 19:53:10 (infos) Waiting 22 minutes for the last 'chunk' to be added to neo4j...
  • 19:51:45 (infos) Importing 128000 rows from publish_traits_1676047141_chunk_10.csv
  • 19:31:39 (infos) Waiting 20 minutes for the last 'chunk' to be added to neo4j...
  • 19:30:18 (infos) Importing 128000 rows from publish_traits_1676047141_chunk_9.csv
  • 19:12:11 (infos) Waiting 18 minutes for the last 'chunk' to be added to neo4j...
  • 19:10:48 (infos) Importing 128000 rows from publish_traits_1676047141_chunk_8.csv
  • 18:54:41 (infos) Waiting 16 minutes for the last 'chunk' to be added to neo4j...
  • 18:53:27 (infos) Importing 128000 rows from publish_traits_1676047141_chunk_7.csv
  • 18:39:21 (infos) Waiting 14 minutes for the last 'chunk' to be added to neo4j...
  • 18:37:53 (infos) Importing 128000 rows from publish_traits_1676047141_chunk_6.csv
  • 18:25:48 (infos) Waiting 12 minutes for the last 'chunk' to be added to neo4j...
  • 18:24:26 (infos) Importing 128000 rows from publish_traits_1676047141_chunk_5.csv
  • 18:14:22 (infos) Waiting 10 minutes for the last 'chunk' to be added to neo4j...
  • 18:13:01 (infos) Importing 128000 rows from publish_traits_1676047141_chunk_4.csv
  • 18:04:58 (infos) Waiting 8 minutes for the last 'chunk' to be added to neo4j...
  • 18:03:27 (infos) Importing 128000 rows from publish_traits_1676047141_chunk_3.csv
  • 17:57:24 (infos) Waiting 6 minutes for the last 'chunk' to be added to neo4j...
  • 17:56:11 (infos) Importing 128000 rows from publish_traits_1676047141_chunk_2.csv
  • 17:52:09 (infos) Waiting 4 minutes for the last 'chunk' to be added to neo4j...
  • 17:50:56 (infos) Importing 128000 rows from publish_traits_1676047141_chunk_1.csv
  • 17:50:55 (warns) Found 2511025 rows, will break up into 128000
  • 17:50:54 (infos) adding new traits
  • 17:50:54 (infos) not removing any traits
  • 17:50:14 (infos) Connecting to https://content.eol.org/ ...