-
Started:
April 11, 2024 13:36
-
Completed:
18:31:50
-
Failed:
No.
-
Status:
completed
Events (most recent first):
-
17:49:34
(infos)
Connecting to https://content.eol.org/ ...
-
17:49:34
(infos)
polling for trait diff metadata: /resources/20/publish_diffs.json?since=1712827333
-
17:49:34
(starts)
#publish_traits = TraitBank::Slurp.load_resource_from_repo
-
17:49:34
(starts)
Running
-
14:35:39
(ends)
Complete
-
14:35:39
(ends)
TOTAL TIME: 59.0m
-
14:35:39
(starts)
TraitBank::Denormalizer.update_resource_vernaculars
-
14:35:39
(starts)
Running
-
14:35:08
(starts)
Resource#fix_native_nodes
-
14:35:07
(starts)
Running
-
14:35:07
(warns)
Trait Publishing failed: Couldn't load the external resource at: https://eol.org/data/Globi/publish_metadata_chunk_2.csv FROM /gems/ruby/2.7.0/bundler/gems/neo4j-ruby-driver-fe5438fb945d/ffi/neo4j/driver/internal/handlers/response_handler.rb:38:in `check_summary_failure' << /app/lib/trait_bank/slurp.rb:555:in `merge_triple' << /app/lib/trait_bank/slurp.rb:440:in `block in load_csv_where' << /app/lib/trait_bank/slurp.rb:440:in `each' << /app/lib/trait_bank/slurp.rb:440:in `load_csv_where' << /app/lib/trait_bank/slurp.rb:327:in `block (2 levels) in load_csv'
-
14:35:07
(warns)
Exception (Neo4j::Driver::Exceptions::ClientException) FROM: #merge_triple QUERY: {USING PERIODIC COMMIT LOAD CSV WITH HEADERS FROM 'https://eol.org/data/Globi/publish_metadata_chunk_2.csv' AS row WITH row WHERE 1=1
MATCH (metadata:MetaData { eol_pk: row.eol_pk })
MATCH (trait:Trait { eol_pk: row.trait_eol_pk })}
-
14:35:07
(warns)
Exception (Neo4j::Driver::Exceptions::ClientException) QUERY: {USING PERIODIC COMMIT LOAD CSV WITH HEADERS FROM 'https://eol.org/data/Globi/publish_metadata_chunk_2.csv' AS row WITH row WHERE 1=1
MATCH (metadata:MetaData { eol_pk: row.eol_pk })
MATCH (trait:Trait { eol_pk: row.trait_eol_pk })
MERGE (trait)-[:metadata]->(metadata)} MESSAGE: Couldn't load the external resource at: https://eol.org/data/Globi/publish_metadata_chunk_2.csv
-
14:35:07
(warns)
Exception (Neo4j::Driver::Exceptions::ClientException) QUERY: {USING PERIODIC COMMIT LOAD CSV WITH HEADERS FROM 'https://eol.org/data/Globi/publish_metadata_chunk_2.csv' AS row WITH row WHERE 1=1 MERGE (metadata:MetaData { eol_pk: row.eol_pk })
ON CREATE SET metadata.source = row.source
ON MATCH SET metadata.source = row.source
ON CREATE SET metadata.literal = row.literal
ON MATCH SET metadata.literal = row.literal
ON CREATE SET metadata.measurement = row.measurement
ON MATCH SET metadata.measurement = row.measurement} MESSAGE: Couldn't load the external resource at: https://eol.org/data/Globi/publish_metadata_chunk_2.csv
-
14:35:07
(warns)
FAILED on build_nodes query (MetaData), will re-try once...
-
14:35:07
(warns)
Couldn't load the external resource at: https://eol.org/data/Globi/publish_metadata_chunk_2.csv
-
14:35:07
(warns)
Exception (Neo4j::Driver::Exceptions::ClientException) QUERY: {USING PERIODIC COMMIT LOAD CSV WITH HEADERS FROM 'https://eol.org/data/Globi/publish_metadata_chunk_2.csv' AS row WITH row WHERE 1=1 MERGE (metadata:MetaData { eol_pk: row.eol_pk })
ON CREATE SET metadata.source = row.source
ON MATCH SET metadata.source = row.source
ON CREATE SET metadata.literal = row.literal
ON MATCH SET metadata.literal = row.literal
ON CREATE SET metadata.measurement = row.measurement
ON MATCH SET metadata.measurement = row.measurement} MESSAGE: Couldn't load the external resource at: https://eol.org/data/Globi/publish_metadata_chunk_2.csv
-
14:35:05
(infos)
Importing 128000 rows from publish_metadata_chunk_2.csv
-
14:31:04
(infos)
Waiting 4 minutes for the last 'chunk' to be added to neo4j...
-
14:30:40
(infos)
Importing 128000 rows from publish_metadata_chunk_1.csv
-
14:30:40
(warns)
Found 2980195 rows, will break up into 128000
-
14:30:39
(infos)
adding new metadata
-
14:30:38
(infos)
Importing 128000 rows from publish_traits_1676047141.tsv
-
14:30:38
(infos)
adding new traits
-
14:30:38
(infos)
not removing any traits
-
14:30:06
(infos)
Connecting to https://content.eol.org/ ...
-
14:30:06
(infos)
/data/Globi/publish_traits_1676047141.tsv: Scheme missing.
-
14:30:06
(warns)
USING wget TO RETRIEVE FULL FILE...
-
14:30:06
(warns)
TRUNCATED RESPONSE! Got 295425359 bytes out of 798115280 from https://content.eol.org/data/Globi/publish_traits_1676047141.tsv
-
14:29:56
(infos)
Connecting to https://content.eol.org/ ...
-
14:29:56
(infos)
polling for trait diff metadata: /resources/20/publish_diffs.json?since=1712827333
-
14:29:56
(starts)
#publish_traits = TraitBank::Slurp.load_resource_from_repo
-
14:29:56
(starts)
Running
-
14:29:56
(warns)
There were NO new pages, skipping...
-
14:28:36
(starts)
create_new_pages
-
14:28:31
(starts)
PageCreator
-
14:28:31
(starts)
Running
-
14:28:31
(starts)
restoring vernacular preferences...
-
14:28:31
(starts)
Running
-
14:28:31
(warns)
MISSING https://content.eol.org/data/Globi/publish_content_sections.tsv [404] (8 bytes); skipping
-
14:28:31
(infos)
Connecting to https://content.eol.org/ ...
-
14:28:31
(starts)
#grab_file content_sections.tsv
-
14:28:31
(starts)
Running
-
14:28:31
(starts)
#import_and_prop_ids ContentSection
-
14:28:31
(starts)
Running
-
14:28:31
(warns)
MISSING https://content.eol.org/data/Globi/publish_references.tsv [404] (8 bytes); skipping
-
14:28:31
(infos)
Connecting to https://content.eol.org/ ...
-
14:28:31
(starts)
#grab_file references.tsv
-
14:28:31
(starts)
Running
-
14:28:31
(starts)
#import_and_prop_ids Reference
