dcsimg

Import Log for GBIF data coverage

  • Started: May 28, 2024 11:12
  • Completed: 16:28:43
  • Failed: No.
  • Status: completed

Events (most recent first):

  • 13:05:13 (infos) fast.rb:334>each.rb:9>slurp.rb:275>pub_log.rb:48= Importing 128000 rows from publish_traits_chunk_5.csv
  • 12:55:12 (infos) fast.rb:334>each.rb:9>slurp.rb:329>pub_log.rb:48= Waiting 10 minutes for the part 5 of 15 to be added to neo4j.
  • 12:55:12 (infos) fast.rb:334>each.rb:9>slurp.rb:351>pub_log.rb:48= Nodes: 447432; Traits: 434400; MetaData: 0
  • 12:54:11 (infos) fast.rb:334>each.rb:9>slurp.rb:275>pub_log.rb:48= Importing 128000 rows from publish_traits_chunk_4.csv
  • 12:46:10 (infos) fast.rb:334>each.rb:9>slurp.rb:329>pub_log.rb:48= Waiting 8 minutes for the part 4 of 15 to be added to neo4j.
  • 12:46:10 (infos) fast.rb:334>each.rb:9>slurp.rb:351>pub_log.rb:48= Nodes: 319432; Traits: 306400; MetaData: 0
  • 12:44:58 (infos) fast.rb:334>each.rb:9>slurp.rb:275>pub_log.rb:48= Importing 128000 rows from publish_traits_chunk_3.csv
  • 12:38:57 (infos) fast.rb:334>each.rb:9>slurp.rb:329>pub_log.rb:48= Waiting 6 minutes for the part 3 of 15 to be added to neo4j.
  • 12:38:57 (infos) fast.rb:334>each.rb:9>slurp.rb:351>pub_log.rb:48= Nodes: 191432; Traits: 178849; MetaData: 0
  • 12:37:48 (infos) fast.rb:334>each.rb:9>slurp.rb:275>pub_log.rb:48= Importing 128000 rows from publish_traits_chunk_2.csv
  • 12:33:47 (infos) fast.rb:334>each.rb:9>slurp.rb:329>pub_log.rb:48= Waiting 4 minutes for the part 2 of 15 to be added to neo4j.
  • 12:33:47 (infos) fast.rb:334>each.rb:9>slurp.rb:351>pub_log.rb:48= Nodes: 70918; Traits: 70918; MetaData: 0
  • 12:32:46 (infos) fast.rb:334>each.rb:9>slurp.rb:275>pub_log.rb:48= Importing 128000 rows from publish_traits_chunk_1.csv
  • 12:32:46 (warns) resource.rb:225>fast.rb:334>slurp.rb:308>pub_log.rb:48= Found 1901539 rows, will break up into 15 of 128000
  • 12:32:46 (infos) resource.rb:225>fast.rb:334>slurp.rb:582>pub_log.rb:48= adding new traits
  • 12:32:46 (infos) resource.rb:225>fast.rb:334>slurp.rb:611>pub_log.rb:48= not removing any traits
  • 12:32:46 (infos) fast.rb:334>slurp.rb:20>content_server_connection.rb:106>pub_log.rb:48= Connecting to https://content.eol.org/ ...
  • 12:32:33 (infos) fast.rb:334>slurp.rb:20>content_server_connection.rb:106>pub_log.rb:48= Connecting to https://content.eol.org/ ...
  • 12:32:29 (infos) fast.rb:334>slurp.rb:20>content_server_connection.rb:106>pub_log.rb:48= polling for trait diff metadata: /resources/1220/publish_diffs.json
  • 12:32:29 (starts) delayed_job.rb:17>resource.rb:225>fast.rb:202>pub_log.rb:48= #publish_traits = TraitBank::Slurp.load_resource_from_repo
  • 12:32:29 (starts) resource.rb:225>fast.rb:202>pub_log.rb:20>import_log.rb:82= Running
  • 12:32:29 (warns) resource.rb:225>fast.rb:155>page_creator.rb:22>pub_log.rb:48= There were NO new pages, skipping...
  • 12:29:30 (starts) resource.rb:225>fast.rb:155>page_creator.rb:5>pub_log.rb:48= create_new_pages
  • 12:29:24 (starts) delayed_job.rb:17>resource.rb:225>fast.rb:154>pub_log.rb:48= PageCreator
  • 12:29:24 (starts) resource.rb:225>fast.rb:154>pub_log.rb:20>import_log.rb:82= Running
  • 12:29:24 (starts) delayed_job.rb:17>resource.rb:225>fast.rb:150>pub_log.rb:48= restoring vernacular preferences...
  • 12:29:24 (starts) resource.rb:225>fast.rb:150>pub_log.rb:20>import_log.rb:82= Running
  • 12:29:24 (warns) resource.rb:225>fast.rb:246>content_server_connection.rb:114>pub_log.rb:48= MISSING https://content.eol.org/data/gbif_data_covera/publish_content_sections.tsv [404] (9 bytes); skipping
  • 12:29:24 (infos) resource.rb:225>fast.rb:246>content_server_connection.rb:106>pub_log.rb:48= Connecting to https://content.eol.org/ ...
  • 12:29:24 (starts) delayed_job.rb:17>resource.rb:225>fast.rb:245>pub_log.rb:48= #grab_file content_sections.tsv
  • 12:29:24 (starts) resource.rb:225>fast.rb:245>pub_log.rb:20>import_log.rb:82= Running
  • 12:29:24 (starts) delayed_job.rb:17>resource.rb:225>fast.rb:222>pub_log.rb:48= #import_and_prop_ids ContentSection
  • 12:29:24 (starts) resource.rb:225>fast.rb:222>pub_log.rb:20>import_log.rb:82= Running
  • 12:29:24 (warns) resource.rb:225>fast.rb:246>content_server_connection.rb:114>pub_log.rb:48= MISSING https://content.eol.org/data/gbif_data_covera/publish_references.tsv [404] (9 bytes); skipping
  • 12:29:24 (infos) resource.rb:225>fast.rb:246>content_server_connection.rb:106>pub_log.rb:48= Connecting to https://content.eol.org/ ...
  • 12:29:24 (starts) delayed_job.rb:17>resource.rb:225>fast.rb:245>pub_log.rb:48= #grab_file references.tsv
  • 12:29:24 (starts) resource.rb:225>fast.rb:245>pub_log.rb:20>import_log.rb:82= Running
  • 12:29:24 (starts) delayed_job.rb:17>resource.rb:225>fast.rb:222>pub_log.rb:48= #import_and_prop_ids Reference
  • 12:29:24 (starts) resource.rb:225>fast.rb:222>pub_log.rb:20>import_log.rb:82= Running
  • 12:29:24 (warns) resource.rb:225>fast.rb:246>content_server_connection.rb:114>pub_log.rb:48= MISSING https://content.eol.org/data/gbif_data_covera/publish_image_info.tsv [404] (9 bytes); skipping
  • 12:29:24 (infos) resource.rb:225>fast.rb:246>content_server_connection.rb:106>pub_log.rb:48= Connecting to https://content.eol.org/ ...
  • 12:29:24 (starts) delayed_job.rb:17>resource.rb:225>fast.rb:245>pub_log.rb:48= #grab_file image_info.tsv
  • 12:29:24 (starts) resource.rb:225>fast.rb:245>pub_log.rb:20>import_log.rb:82= Running
  • 12:29:24 (starts) delayed_job.rb:17>resource.rb:225>fast.rb:222>pub_log.rb:48= #import_and_prop_ids ImageInfo
  • 12:29:24 (starts) resource.rb:225>fast.rb:222>pub_log.rb:20>import_log.rb:82= Running
  • 12:29:24 (warns) resource.rb:225>fast.rb:246>content_server_connection.rb:114>pub_log.rb:48= MISSING https://content.eol.org/data/gbif_data_covera/publish_attributions.tsv [404] (9 bytes); skipping
  • 12:29:24 (infos) resource.rb:225>fast.rb:246>content_server_connection.rb:106>pub_log.rb:48= Connecting to https://content.eol.org/ ...
  • 12:29:24 (starts) delayed_job.rb:17>resource.rb:225>fast.rb:245>pub_log.rb:48= #grab_file attributions.tsv
  • 12:29:24 (starts) resource.rb:225>fast.rb:245>pub_log.rb:20>import_log.rb:82= Running
  • 12:29:24 (starts) delayed_job.rb:17>resource.rb:225>fast.rb:222>pub_log.rb:48= #import_and_prop_ids Attribution