Import Log for Global Biotic Interactions

• Started: April 16, 2024 17:41
• Completed: 10:05:13
• Failed: No.
• Status: completed

Events (most recent first):

• « First
• 1
• 2
• 3
• 4
• 5
• 6
• 7
• 8
• Last »

• 17:59:25 (infos) each.rb:9:in `each'> slurp.rb:329:in `block in break_up_large_file'> Waiting 4 minutes for the part 2 of 24 to be added to neo4j.
• 17:59:25 (infos) each.rb:9:in `each'> slurp.rb:351:in `log_node_count'> Nodes: 128000; Traits: 128000; MetaData: 0
• 17:58:05 (infos) each.rb:9:in `each'> slurp.rb:275:in `block in load_csv'> Importing 128000 rows from publish_traits_chunk_1.csv
• 17:58:04 (warns) fast.rb:334:in `publish_traits'> slurp.rb:308:in `break_up_large_files'> Found 2980195 rows, will break up into 24 of 128000
• 17:58:02 (infos) fast.rb:334:in `publish_traits'> slurp.rb:582:in `add_traits'> adding new traits
• 17:58:02 (infos) fast.rb:334:in `publish_traits'> slurp.rb:611:in `remove_traits'> not removing any traits
• 17:57:30 (infos) slurp.rb:20:in `load_resource_from_repo'> content_server_connection.rb:106:in `log_info'> Downloaded: 1 files, 385M in 21s (18.7 MB/s)
• 17:57:30 (infos) slurp.rb:20:in `load_resource_from_repo'> content_server_connection.rb:106:in `log_info'> FINISHED --2024-04-16 21:57:30--
• 17:57:30 (infos) slurp.rb:20:in `load_resource_from_repo'> content_server_connection.rb:106:in `log_info'> 2024-04-16 21:57:30 (35.7 MB/s) - ‘/app/tmp/Globi_tmp_1713304627_publish_metadata.tsv’ saved [747585637/747585637]
• 17:57:30 (infos) slurp.rb:20:in `load_resource_from_repo'> content_server_connection.rb:106:in `log_info'> Saving to: ‘/app/tmp/Globi_tmp_1713304627_publish_metadata.tsv’
• 17:57:30 (infos) slurp.rb:20:in `load_resource_from_repo'> content_server_connection.rb:106:in `log_info'> Length: 747585637 (713M), 403186438 (385M) remaining [application/octet-stream]
• 17:57:30 (infos) slurp.rb:20:in `load_resource_from_repo'> content_server_connection.rb:106:in `log_info'> HTTP request sent, awaiting response... 206 Partial Content
• 17:57:30 (infos) slurp.rb:20:in `load_resource_from_repo'> content_server_connection.rb:106:in `log_info'> Connecting to content.eol.org (content.eol.org)|160.111.248.42|:443... connected.
• 17:57:30 (infos) slurp.rb:20:in `load_resource_from_repo'> content_server_connection.rb:106:in `log_info'> Saving to: ‘/app/tmp/Globi_tmp_1713304627_publish_metadata.tsv’
• 17:57:30 (infos) slurp.rb:20:in `load_resource_from_repo'> content_server_connection.rb:106:in `log_info'> Length: 747585637 (713M) [application/octet-stream]
• 17:57:30 (infos) slurp.rb:20:in `load_resource_from_repo'> content_server_connection.rb:106:in `log_info'> HTTP request sent, awaiting response... 200 OK
• 17:57:30 (infos) slurp.rb:20:in `load_resource_from_repo'> content_server_connection.rb:106:in `log_info'> Connecting to content.eol.org (content.eol.org)|160.111.248.42|:443... connected.
• 17:57:30 (infos) slurp.rb:20:in `load_resource_from_repo'> content_server_connection.rb:106:in `log_info'> Resolving content.eol.org (content.eol.org)... 160.111.248.42
• 17:57:30 (warns) slurp.rb:20:in `load_resource_from_repo'> content_server_connection.rb:114:in `log_warn'> Took 23 seconds.
• 17:57:07 (warns) slurp.rb:20:in `load_resource_from_repo'> content_server_connection.rb:114:in `log_warn'> USING wget TO RETRIEVE FULL FILE...
• 17:57:07 (warns) slurp.rb:20:in `load_resource_from_repo'> content_server_connection.rb:114:in `log_warn'> TRUNCATED RESPONSE! Got 266253535 bytes out of 747585637 from https://content.eol.org/data/Globi/publish_metadata.tsv
• 17:56:58 (infos) slurp.rb:20:in `load_resource_from_repo'> content_server_connection.rb:106:in `log_info'> Connecting to https://content.eol.org/ ...
• 17:56:17 (infos) slurp.rb:20:in `load_resource_from_repo'> content_server_connection.rb:106:in `log_info'> Downloaded: 1 files, 215M in 26s (8.40 MB/s)
• 17:56:17 (infos) slurp.rb:20:in `load_resource_from_repo'> content_server_connection.rb:106:in `log_info'> FINISHED --2024-04-16 21:56:16--
• 17:56:17 (infos) slurp.rb:20:in `load_resource_from_repo'> content_server_connection.rb:106:in `log_info'> 2024-04-16 21:56:16 (41.4 MB/s) - ‘/app/tmp/Globi_tmp_1713304547_publish_traits.tsv’ saved [949928114/949928114]
• 17:56:17 (infos) slurp.rb:20:in `load_resource_from_repo'> content_server_connection.rb:106:in `log_info'> Saving to: ‘/app/tmp/Globi_tmp_1713304547_publish_traits.tsv’
• 17:56:17 (infos) slurp.rb:20:in `load_resource_from_repo'> content_server_connection.rb:106:in `log_info'> Length: 949928114 (906M), 224990575 (215M) remaining [application/octet-stream]
• 17:56:17 (infos) slurp.rb:20:in `load_resource_from_repo'> content_server_connection.rb:106:in `log_info'> HTTP request sent, awaiting response... 206 Partial Content
• 17:56:17 (infos) slurp.rb:20:in `load_resource_from_repo'> content_server_connection.rb:106:in `log_info'> Connecting to content.eol.org (content.eol.org)|160.111.248.42|:443... connected.
• 17:56:17 (infos) slurp.rb:20:in `load_resource_from_repo'> content_server_connection.rb:106:in `log_info'> Saving to: ‘/app/tmp/Globi_tmp_1713304547_publish_traits.tsv’
• 17:56:17 (infos) slurp.rb:20:in `load_resource_from_repo'> content_server_connection.rb:106:in `log_info'> Length: 949928114 (906M), 575442371 (549M) remaining [application/octet-stream]
• 17:56:17 (infos) slurp.rb:20:in `load_resource_from_repo'> content_server_connection.rb:106:in `log_info'> HTTP request sent, awaiting response... 206 Partial Content
• 17:56:17 (infos) slurp.rb:20:in `load_resource_from_repo'> content_server_connection.rb:106:in `log_info'> Connecting to content.eol.org (content.eol.org)|160.111.248.42|:443... connected.
• 17:56:17 (infos) slurp.rb:20:in `load_resource_from_repo'> content_server_connection.rb:106:in `log_info'> Saving to: ‘/app/tmp/Globi_tmp_1713304547_publish_traits.tsv’
• 17:56:17 (infos) slurp.rb:20:in `load_resource_from_repo'> content_server_connection.rb:106:in `log_info'> Length: 949928114 (906M) [application/octet-stream]
• 17:56:17 (infos) slurp.rb:20:in `load_resource_from_repo'> content_server_connection.rb:106:in `log_info'> HTTP request sent, awaiting response... 200 OK
• 17:56:17 (infos) slurp.rb:20:in `load_resource_from_repo'> content_server_connection.rb:106:in `log_info'> Connecting to content.eol.org (content.eol.org)|160.111.248.42|:443... connected.
• 17:56:17 (infos) slurp.rb:20:in `load_resource_from_repo'> content_server_connection.rb:106:in `log_info'> Resolving content.eol.org (content.eol.org)... 160.111.248.42
• 17:56:17 (warns) slurp.rb:20:in `load_resource_from_repo'> content_server_connection.rb:114:in `log_warn'> Took 30 seconds.
• 17:55:47 (warns) slurp.rb:20:in `load_resource_from_repo'> content_server_connection.rb:114:in `log_warn'> USING wget TO RETRIEVE FULL FILE...
• 17:55:47 (warns) slurp.rb:20:in `load_resource_from_repo'> content_server_connection.rb:114:in `log_warn'> TRUNCATED RESPONSE! Got 115170663 bytes out of 949928114 from https://content.eol.org/data/Globi/publish_traits.tsv
• 17:55:44 (infos) slurp.rb:20:in `load_resource_from_repo'> content_server_connection.rb:106:in `log_info'> Connecting to https://content.eol.org/ ...
• 17:55:44 (infos) slurp.rb:20:in `load_resource_from_repo'> content_server_connection.rb:106:in `log_info'> polling for trait diff metadata: /resources/20/publish_diffs.json
• 17:55:44 (starts) resource.rb:225:in `publish'> fast.rb:202:in `publish_traits_with_cleanup'> #publish_traits = TraitBank::Slurp.load_resource_from_repo
• 17:55:44 (starts) resource.rb:225:in `publish'> fast.rb:202:in `publish_traits_with_cleanup'> Running
• 17:55:44 (warns) fast.rb:155:in `by_resource'> page_creator.rb:22:in `by_node_pks'> There were NO new pages, skipping...
• 17:54:25 (starts) fast.rb:155:in `by_resource'> page_creator.rb:5:in `by_node_pks'> create_new_pages
• 17:54:19 (starts) resource.rb:225:in `publish'> fast.rb:154:in `by_resource'> PageCreator
• 17:54:19 (starts) resource.rb:225:in `publish'> fast.rb:154:in `by_resource'> Running
• 17:54:19 (starts) resource.rb:225:in `publish'> fast.rb:150:in `by_resource'> restoring vernacular preferences...

• « First
• 1
• 2
• 3
• 4
• 5
• 6
• 7
• 8
• Last »