dcsimg

Import Log for World Register of Marine Species

  • Started: January 30, 2023 17:04
  • Completed: 18:08:03
  • Failed: No.
  • Status: completed

Events (most recent first):

  • 18:08:03 (ends) Complete
  • 18:08:03 (ends) TOTAL TIME: 63.7m
  • 18:06:23 (starts) #fix_missing_icons (just to be safe)
  • 18:06:23 (starts) Running
  • 18:06:12 (starts) #propagate_reference_ids
  • 18:06:12 (starts) Running
  • 18:05:59 (starts) TraitBank::Denormalizer.update_resource_vernaculars
  • 18:05:59 (starts) Running
  • 18:05:50 (starts) Resource#fix_native_nodes
  • 18:05:50 (starts) Running
  • 18:05:50 (infos) Removing /app/tmp/world_reg_mar_sp_content_sections.tsv
  • 18:05:50 (infos) Removing /app/tmp/world_reg_mar_sp_references.tsv
  • 18:05:50 (infos) Removing /app/tmp/world_reg_mar_sp_image_info.tsv
  • 18:05:50 (infos) Removing /app/tmp/world_reg_mar_sp_attributions.tsv
  • 18:05:50 (infos) Removing /app/tmp/world_reg_mar_sp_media.tsv
  • 18:05:50 (infos) Removing /app/tmp/world_reg_mar_sp_articles.tsv
  • 18:05:50 (infos) Removing /app/tmp/world_reg_mar_sp_vernaculars.tsv
  • 18:05:50 (infos) Removing /app/tmp/world_reg_mar_sp_node_ancestors.tsv
  • 18:05:50 (infos) Removing /app/tmp/world_reg_mar_sp_scientific_names.tsv
  • 18:05:50 (infos) Removing /app/tmp/world_reg_mar_sp_identifiers.tsv
  • 18:05:50 (infos) Removing /app/tmp/world_reg_mar_sp_bibliographic_citations.tsv
  • 18:05:50 (infos) Removing /app/tmp/world_reg_mar_sp_nodes.tsv
  • 18:05:50 (infos) Removing /app/tmp/world_reg_mar_sp_referents.tsv
  • 18:05:50 (infos) Removing trait and metadata files
  • 18:05:35 (infos) Importing 128000 rows from new_metadata_1658252355_1675086001.csv
  • 18:05:34 (infos) adding new metadata
  • 18:04:42 (infos) Importing 128000 rows from new_traits_1658252355_1675086001_chunk_3.csv
  • 18:03:13 (infos) Importing 128000 rows from new_traits_1658252355_1675086001_chunk_2.csv
  • 17:59:13 (infos) Waiting 4 minutes for the last 'chunk' to be added to neo4j...
  • 17:57:45 (infos) Importing 128000 rows from new_traits_1658252355_1675086001_chunk_1.csv
  • 17:57:44 (warns) Found 331496 rows, will break up into 128000
  • 17:57:44 (infos) adding new traits
  • 17:57:44 (infos) removed 498432 traits
  • 17:21:15 (infos) removing traits specified in diff file
  • 17:21:15 (infos) Connecting to https://content.eol.org/ ...
  • 17:21:15 (infos) Connecting to https://content.eol.org/ ...
  • 17:21:12 (infos) Connecting to https://content.eol.org/ ...
  • 17:21:02 (infos) harvesting server processing results, waiting for completion... (attempt 11/60)
  • 17:20:52 (infos) harvesting server processing results, waiting for completion... (attempt 10/60)
  • 17:20:42 (infos) harvesting server processing results, waiting for completion... (attempt 9/60)
  • 17:20:32 (infos) harvesting server processing results, waiting for completion... (attempt 8/60)
  • 17:20:22 (infos) harvesting server processing results, waiting for completion... (attempt 7/60)
  • 17:20:12 (infos) harvesting server processing results, waiting for completion... (attempt 6/60)
  • 17:20:02 (infos) harvesting server processing results, waiting for completion... (attempt 5/60)
  • 17:19:52 (infos) harvesting server processing results, waiting for completion... (attempt 4/60)
  • 17:19:42 (infos) harvesting server processing results, waiting for completion... (attempt 3/60)
  • 17:19:32 (infos) harvesting server processing results, waiting for completion... (attempt 2/60)
  • 17:19:22 (infos) harvesting server processing results, waiting for completion... (attempt 1/60)
  • 17:19:22 (infos) polling for trait diff metadata: /resources/533/publish_diffs.json?since=1672170346
  • 17:19:22 (starts) #publish_traits = TraitBank::Slurp.load_resource_from_repo