dcsimg

Import Log for Global Biotic Interactions

  • Started: April 16, 2024 11:35
  • Completed: 13:18:23
  • Failed: No.
  • Status: completed

Events (most recent first):

  • 13:21:43 (infos) resource.rb:505:in `background_republish'> content_server_connection.rb:104:in `log_info'> Connecting to https://content.eol.org/ ...
  • 13:21:43 (infos) resource.rb:505:in `background_republish'> content_server_connection.rb:104:in `log_info'> /data/Globi/publish_traits.tsv: Scheme missing.
  • 13:21:43 (warns) resource.rb:505:in `background_republish'> content_server_connection.rb:112:in `log_warn'> USING wget TO RETRIEVE FULL FILE...
  • 13:21:43 (warns) resource.rb:505:in `background_republish'> content_server_connection.rb:112:in `log_warn'> TRUNCATED RESPONSE! Got 278483463 bytes out of 949928114 from https://content.eol.org/data/Globi/publish_traits.tsv
  • 13:21:27 (infos) resource.rb:505:in `background_republish'> content_server_connection.rb:104:in `log_info'> Connecting to https://content.eol.org/ ...
  • 13:21:24 (infos) resource.rb:505:in `background_republish'> content_server_connection.rb:104:in `log_info'> polling for trait diff metadata: /resources/20/publish_diffs.json
  • 13:18:32 (ends) resource.rb:225:in `publish'> fast.rb:177:in `ensure in by_resource'> Complete
  • 13:18:21 (ends) resource.rb:225:in `publish'> fast.rb:176:in `ensure in by_resource'> TOTAL TIME: 1.7h
  • 13:03:17 (infos) each.rb:9:in `each'> slurp.rb:329:in `block in break_up_large_file'> Waiting 16 minutes for the part 8 of 24 to be added to neo4j.
  • 13:03:16 (infos) each.rb:9:in `each'> slurp.rb:351:in `log_node_count'> Nodes: 0; Traits: 0; MetaData: 0
  • 13:02:45 (infos) each.rb:9:in `each'> slurp.rb:275:in `block in load_csv'> Importing 128000 rows from publish_metadata_chunk_7.csv
  • 12:48:42 (infos) each.rb:9:in `each'> slurp.rb:329:in `block in break_up_large_file'> Waiting 14 minutes for the part 7 of 24 to be added to neo4j.
  • 12:48:42 (infos) each.rb:9:in `each'> slurp.rb:351:in `log_node_count'> Nodes: 0; Traits: 0; MetaData: 0
  • 12:48:12 (infos) each.rb:9:in `each'> slurp.rb:275:in `block in load_csv'> Importing 128000 rows from publish_metadata_chunk_6.csv
  • 12:36:09 (infos) each.rb:9:in `each'> slurp.rb:329:in `block in break_up_large_file'> Waiting 12 minutes for the part 6 of 24 to be added to neo4j.
  • 12:36:09 (infos) each.rb:9:in `each'> slurp.rb:351:in `log_node_count'> Nodes: 0; Traits: 0; MetaData: 0
  • 12:35:43 (infos) each.rb:9:in `each'> slurp.rb:275:in `block in load_csv'> Importing 128000 rows from publish_metadata_chunk_5.csv
  • 12:25:41 (infos) each.rb:9:in `each'> slurp.rb:329:in `block in break_up_large_file'> Waiting 10 minutes for the part 5 of 24 to be added to neo4j.
  • 12:25:41 (infos) each.rb:9:in `each'> slurp.rb:351:in `log_node_count'> Nodes: 0; Traits: 0; MetaData: 0
  • 12:25:15 (infos) each.rb:9:in `each'> slurp.rb:275:in `block in load_csv'> Importing 128000 rows from publish_metadata_chunk_4.csv
  • 12:17:14 (infos) each.rb:9:in `each'> slurp.rb:329:in `block in break_up_large_file'> Waiting 8 minutes for the part 4 of 24 to be added to neo4j.
  • 12:17:14 (infos) each.rb:9:in `each'> slurp.rb:351:in `log_node_count'> Nodes: 0; Traits: 0; MetaData: 0
  • 12:16:46 (infos) each.rb:9:in `each'> slurp.rb:275:in `block in load_csv'> Importing 128000 rows from publish_metadata_chunk_3.csv
  • 12:10:44 (infos) each.rb:9:in `each'> slurp.rb:329:in `block in break_up_large_file'> Waiting 6 minutes for the part 3 of 24 to be added to neo4j.
  • 12:10:44 (infos) each.rb:9:in `each'> slurp.rb:351:in `log_node_count'> Nodes: 0; Traits: 0; MetaData: 0
  • 12:10:19 (infos) each.rb:9:in `each'> slurp.rb:275:in `block in load_csv'> Importing 128000 rows from publish_metadata_chunk_2.csv
  • 12:06:18 (infos) each.rb:9:in `each'> slurp.rb:329:in `block in break_up_large_file'> Waiting 4 minutes for the part 2 of 24 to be added to neo4j.
  • 12:06:18 (infos) each.rb:9:in `each'> slurp.rb:351:in `log_node_count'> Nodes: 0; Traits: 0; MetaData: 0
  • 12:05:51 (infos) each.rb:9:in `each'> slurp.rb:275:in `block in load_csv'> Importing 128000 rows from publish_metadata_chunk_1.csv
  • 12:05:50 (warns) fast.rb:334:in `publish_traits'> slurp.rb:308:in `break_up_large_files'> Found 2980195 rows, will break up into 24 of 128000
  • 12:05:49 (infos) fast.rb:334:in `publish_traits'> slurp.rb:592:in `add_metadata'> adding new metadata
  • 12:05:49 (infos) fast.rb:334:in `publish_traits'> slurp.rb:351:in `log_node_count'> Nodes: 0; Traits: 0; MetaData: 0
  • 12:05:46 (infos) fast.rb:334:in `publish_traits'> slurp.rb:275:in `block in load_csv'> Importing 128000 rows from publish_traits_1676047141.tsv
  • 12:05:46 (infos) fast.rb:334:in `publish_traits'> slurp.rb:582:in `add_traits'> adding new traits
  • 12:05:46 (infos) fast.rb:334:in `publish_traits'> slurp.rb:611:in `remove_traits'> not removing any traits
  • 12:05:02 (infos) slurp.rb:20:in `load_resource_from_repo'> content_server_connection.rb:104:in `log_info'> Connecting to https://content.eol.org/ ...
  • 12:05:02 (infos) slurp.rb:20:in `load_resource_from_repo'> content_server_connection.rb:104:in `log_info'> /data/Globi/publish_traits_1676047141.tsv: Scheme missing.
  • 12:05:02 (warns) slurp.rb:20:in `load_resource_from_repo'> content_server_connection.rb:112:in `log_warn'> USING wget TO RETRIEVE FULL FILE...
  • 12:05:02 (warns) slurp.rb:20:in `load_resource_from_repo'> content_server_connection.rb:112:in `log_warn'> TRUNCATED RESPONSE! Got 183480068 bytes out of 798115280 from https://content.eol.org/data/Globi/publish_traits_1676047141.tsv
  • 12:04:50 (infos) slurp.rb:20:in `load_resource_from_repo'> content_server_connection.rb:104:in `log_info'> Connecting to https://content.eol.org/ ...
  • 12:04:50 (infos) slurp.rb:20:in `load_resource_from_repo'> content_server_connection.rb:104:in `log_info'> polling for trait diff metadata: /resources/20/publish_diffs.json
  • 12:04:50 (starts) resource.rb:225:in `publish'> fast.rb:202:in `publish_traits_with_cleanup'> #publish_traits = TraitBank::Slurp.load_resource_from_repo
  • 12:04:50 (starts) resource.rb:225:in `publish'> fast.rb:202:in `publish_traits_with_cleanup'> Running
  • 12:04:50 (warns) fast.rb:155:in `by_resource'> page_creator.rb:22:in `by_node_pks'> There were NO new pages, skipping...
  • 12:03:26 (starts) fast.rb:155:in `by_resource'> page_creator.rb:5:in `by_node_pks'> create_new_pages
  • 12:03:22 (starts) resource.rb:225:in `publish'> fast.rb:154:in `by_resource'> PageCreator
  • 12:03:22 (starts) resource.rb:225:in `publish'> fast.rb:154:in `by_resource'> Running
  • 12:03:22 (starts) resource.rb:225:in `publish'> fast.rb:150:in `by_resource'> restoring vernacular preferences...
  • 12:03:22 (starts) resource.rb:225:in `publish'> fast.rb:150:in `by_resource'> Running
  • 12:03:22 (warns) fast.rb:246:in `grab_file'> content_server_connection.rb:112:in `log_warn'> MISSING https://content.eol.org/data/Globi/publish_content_sections.tsv [404] (8 bytes); skipping