dcsimg

Import Log for GBIF data coverage

  • Started: May 28, 2024 11:12
  • Completed: 16:28:43
  • Failed: No.
  • Status: completed

Events (most recent first):

  • 16:26:55 (warns) fast.rb:334>each.rb:9>slurp.rb:289>pub_log.rb:48= ...re-trying.
  • 16:21:55 (warns) fast.rb:334>each.rb:9>slurp.rb:285>pub_log.rb:48= FAILED on build_nodes query (Page), will re-try 3 times after 5 minute pause (the site may be too busy to serve the CSV to Neo4j)...
  • 16:21:55 (warns) fast.rb:334>each.rb:9>slurp.rb:284>pub_log.rb:48= Cannot merge the following node because of null property value for 'page_id': (page:Page {page_id: null}) (Failure when processing file '/data/gbif_data_covera/publish_traits_chunk_14.csv' on line 59611 (which is the last row in the file).)
  • 16:21:55 (warns) fast.rb:334>each.rb:9>slurp.rb:571>pub_log.rb:48= Exception (Neo4j::Driver::Exceptions::ClientException) QUERY: {USING PERIODIC COMMIT LOAD CSV WITH HEADERS FROM 'https://eol.org/data/gbif_data_covera/publish_traits_chunk_14.csv' AS row WITH row WHERE 1=1 MERGE (page:Page { page_id: toInteger(row.page_id) })} MESSAGE: Cannot merge the following node because of null property value for 'page_id': (page:Page {page_id: null}) (Failure when processing file '/data/gbif_data_covera/publish_traits_chunk_14.csv' on line 59611 (which is the last row in the file).)
  • 13:10:16 (warns) fast.rb:334>each.rb:9>slurp.rb:289>pub_log.rb:48= ...re-trying.
  • 13:05:16 (warns) fast.rb:334>each.rb:9>slurp.rb:285>pub_log.rb:48= FAILED on build_nodes query (Page), will re-try 3 times after 5 minute pause (the site may be too busy to serve the CSV to Neo4j)...
  • 13:05:16 (warns) fast.rb:334>each.rb:9>slurp.rb:284>pub_log.rb:48= Cannot merge the following node because of null property value for 'page_id': (page:Page {page_id: null}) (Failure when processing file '/data/gbif_data_covera/publish_traits_chunk_5.csv' on line 49632 (which is the last row in the file).)
  • 13:05:16 (warns) fast.rb:334>each.rb:9>slurp.rb:571>pub_log.rb:48= Exception (Neo4j::Driver::Exceptions::ClientException) QUERY: {USING PERIODIC COMMIT LOAD CSV WITH HEADERS FROM 'https://eol.org/data/gbif_data_covera/publish_traits_chunk_5.csv' AS row WITH row WHERE 1=1 MERGE (page:Page { page_id: toInteger(row.page_id) })} MESSAGE: Cannot merge the following node because of null property value for 'page_id': (page:Page {page_id: null}) (Failure when processing file '/data/gbif_data_covera/publish_traits_chunk_5.csv' on line 49632 (which is the last row in the file).)
  • 12:32:46 (warns) resource.rb:225>fast.rb:334>slurp.rb:308>pub_log.rb:48= Found 1901539 rows, will break up into 15 of 128000
  • 12:32:29 (warns) resource.rb:225>fast.rb:155>page_creator.rb:22>pub_log.rb:48= There were NO new pages, skipping...
  • 12:29:24 (warns) resource.rb:225>fast.rb:246>content_server_connection.rb:114>pub_log.rb:48= MISSING https://content.eol.org/data/gbif_data_covera/publish_content_sections.tsv [404] (9 bytes); skipping
  • 12:29:24 (warns) resource.rb:225>fast.rb:246>content_server_connection.rb:114>pub_log.rb:48= MISSING https://content.eol.org/data/gbif_data_covera/publish_references.tsv [404] (9 bytes); skipping
  • 12:29:24 (warns) resource.rb:225>fast.rb:246>content_server_connection.rb:114>pub_log.rb:48= MISSING https://content.eol.org/data/gbif_data_covera/publish_image_info.tsv [404] (9 bytes); skipping
  • 12:29:24 (warns) resource.rb:225>fast.rb:246>content_server_connection.rb:114>pub_log.rb:48= MISSING https://content.eol.org/data/gbif_data_covera/publish_attributions.tsv [404] (9 bytes); skipping
  • 12:29:24 (warns) resource.rb:225>fast.rb:246>content_server_connection.rb:114>pub_log.rb:48= MISSING https://content.eol.org/data/gbif_data_covera/publish_media.tsv [404] (9 bytes); skipping
  • 12:29:23 (warns) resource.rb:225>fast.rb:246>content_server_connection.rb:114>pub_log.rb:48= MISSING https://content.eol.org/data/gbif_data_covera/publish_articles.tsv [404] (9 bytes); skipping
  • 12:29:23 (warns) resource.rb:225>fast.rb:246>content_server_connection.rb:114>pub_log.rb:48= MISSING https://content.eol.org/data/gbif_data_covera/publish_vernaculars.tsv [404] (9 bytes); skipping
  • 11:59:18 (warns) resource.rb:225>fast.rb:246>content_server_connection.rb:114>pub_log.rb:48= MISSING https://content.eol.org/data/gbif_data_covera/publish_identifiers.tsv [404] (9 bytes); skipping
  • 11:59:18 (warns) resource.rb:225>fast.rb:246>content_server_connection.rb:114>pub_log.rb:48= MISSING https://content.eol.org/data/gbif_data_covera/publish_bibliographic_citations.tsv [404] (9 bytes); skipping
  • 11:56:49 (warns) resource.rb:225>fast.rb:246>content_server_connection.rb:114>pub_log.rb:48= MISSING https://content.eol.org/data/gbif_data_covera/publish_referents.tsv [404] (9 bytes); skipping
  • 11:56:46 (warns) delayed_job.rb:17>resource.rb:225>fast.rb:143>pub_log.rb:48= All existing content has been destroyed for the resource.