Skip to content

Erro em load_languages #322

@robertatakenaka

Description

@robertatakenaka

Descrição do problema

Erro:

create index [[('aid', 1)], {'background': True}] (articles)
create index [[('version', 1)], {'background': True}] (articles)
create index [[('code', 1), ('collection', 1)], {'unique': True, 'background': True}] (articles)
create index [[('collection', 1), ('processing_date', 1)], {'background': True}] (articles)
06:42:24 - processing.load_languages - INFO - Loading languages for www.scielo.org.ar
06:42:24 - processing.load_languages - INFO - Using mode all_records True
06:42:24 - processing.load_languages - INFO - Loading static_pdf_files.txt from server www.scielo.org.ar
06:42:27 - processing.load_languages - INFO - Loading static_html_files.txt from server www.scielo.org.ar
06:42:28 - processing.load_languages - INFO - Loading static_xml_files.txt from server www.scielo.org.ar
/usr/local/lib/python3.10/site-packages/pymongo/collection.py:1696: UserWarning: use an explicit session with no_cursor_timeout=True otherwise the cursor may still timeout after 30 minut
es, for more info see https://docs.mongodb.com/v4.4/reference/method/cursor.noCursorTimeout/#session-idle-timeout-overrides-nocursortimeout
  return Cursor(self, *args, **kwargs)
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/processing/load_languages.py", line 95, in get_acron_issueid_fname_without_extension
    file_id = FILE_REGEX.search(_file_path).group()
AttributeError: 'NoneType' object has no attribute 'group'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/bin/articlemeta_loadlanguages", line 7, in <module>
    sys.exit(main())
  File "/usr/local/lib/python3.10/site-packages/processing/load_languages.py", line 497, in main
    run(collections, articlemeta_db, args.all_records, args.domain)
  File "/usr/local/lib/python3.10/site-packages/processing/load_languages.py", line 409, in run
    fulltexts = static_catalogs.fulltexts(document)
  File "/usr/local/lib/python3.10/site-packages/processing/load_languages.py", line 313, in fulltexts
    file_id = self._file_id(document.file_code(fullpath=True))
  File "/usr/local/lib/python3.10/site-packages/processing/load_languages.py", line 239, in _file_id
    return get_acron_issueid_fname_without_extension(file_path)
  File "/usr/local/lib/python3.10/site-packages/processing/load_languages.py", line 109, in get_acron_issueid_fname_without_extension
    u'Fail to parse file_path %s for %s', (file_path, file_id))
UnboundLocalError: local variable 'file_id' referenced before assignment

ao consumir a lista

./argos/aceeed/n21/2545-8299-ACEEED-21-137.xml
./argos/aceeed/n21/2545-8299-ACEEED-21-15.xml
./argos/aceeed/n21/2545-8299-ACEEED-21-169.xml
./argos/aceeed/n21/2545-8299-ACEEED-21-29.xml
./argos/aceeed/n21/2545-8299-ACEEED-21-71.xml
./argos/aceeed/n21/2545-8299-ACEEED-21-97.xml
./argos/aceeed/n21/2545-8299-ACEEED-21-207.xml

Sendo assim, corrigir o script para que se o padrão não for correspondido, registre a exceção, mas não interrompa a execução do script. No final indique os problemas encontrados.

Metadata

Metadata

Labels

bugSomething isn't working

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions