Error in search-trends prod: failed to parse date field
https://console-openshift-console.apps.jocp4.arbetsformedlingen.se/k8s/cluster/projects (requires vpn)
step-process
2023/03/30 02:20:43 warning: unsuccessful cred copy: ".docker" from "/tekton/creds" to "/": unable to create destination directory: mkdir /.docker: permission denied
2023-03-30 02:20:46.393 | INFO | search_stats.main:main:14 - start processing data from $(tasks.get-date.results.date)
2023-03-30 02:20:46.393 | INFO | search_stats.main:main:15 - Lower hits limit: 0, Lower word length limit: 2
2023-03-30 02:20:46.394 | INFO | search_stats.main:main:16 - Collection logs from : jobsearch.api.jobtechdev.se
2023-03-30 02:20:46.394 | INFO | search_stats.create_temp_files:create_temp_files_from_whole_day:24 - Time interval: $(tasks.get-date.results.date)T00:00:00.000Z - $(tasks.get-date.results.date)T00:59:59.999Z
2023-03-30 02:20:46.394 | INFO | search_stats.opensearch:scan:26 - starting scan
2023-03-30 02:20:46.566 | INFO | search_stats.opensearch:create_opensearch_client:21 - {'name': 'opensearch-onprem', 'cluster_name': 'opensearch', 'cluster_uuid': '43jZbVULSXy7L4dMOraerg', 'version': {'distribution': 'opensearch', 'number': '2.2.0', 'build_type': 'tar', 'build_hash': 'b1017fa3b9a1c781d4f34ecee411e0cdf930a515', 'build_date': '2022-08-09T02:27:25.256769336Z', 'build_snapshot': False, 'lucene_version': '9.3.0', 'minimum_wire_compatibility_version': '7.10.0', 'minimum_index_compatibility_version': '7.0.0'}, 'tagline': 'The OpenSearch Project: https://opensearch.org/'}
2023-03-30 02:20:46.567 | INFO | search_stats.opensearch:scan:29 - scan finished, processing result
2023-03-30 02:20:46.644 | ERROR | __main__:<module>:8 - An error has been caught in function '<module>', process 'MainProcess' (16), thread 'MainThread' (140642307336000):
Traceback (most recent call last):
> File "/usr/local/bin/collect_stats", line 8, in <module>
sys.exit(main())
│ │ └ <function main at 0x7fe9d44aaf80>
│ └ <built-in function exit>
└ <module 'sys' (built-in)>
File "/usr/local/lib/python3.10/site-packages/search_stats/main.py", line 17, in main
create_temp_files_from_whole_day(working_date)
│ └ '$(tasks.get-date.results.date)'
└ <function create_temp_files_from_whole_day at 0x7fe9d4ff7250>
File "/usr/local/lib/python3.10/site-packages/search_stats/create_temp_files.py", line 27, in create_temp_files_from_whole_day
raw_results = parse_scan_result(scan_results)
│ └ <generator object scan at 0x7fe9d43412a0>
└ <function parse_scan_result at 0x7fe9d59ef400>
File "/usr/local/lib/python3.10/site-packages/search_stats/query_string_parser.py", line 8, in parse_scan_result
for row in scan_result:
└ <generator object scan at 0x7fe9d43412a0>
File "/usr/local/lib/python3.10/site-packages/opensearchpy/helpers/actions.py", line 566, in scan
resp = client.search(
│ └ <function OpenSearch.search at 0x7fe9d59ed480>
└ <OpenSearch([{'host': '10.126.2.101', 'port': '9200'}])>
File "/usr/local/lib/python3.10/site-packages/opensearchpy/client/utils.py", line 177, in _wrapped
return func(*args, params=params, headers=headers, **kwargs)
│ │ │ │ └ {'body': {'fields': [{'field': 'calamari.request.query_string'}], 'query': {'bool': {'filter': [{'range': {'@timestamp': {'fo...
│ │ │ └ {}
│ │ └ {'scroll': b'15m', 'size': '10000'}
│ └ (<OpenSearch([{'host': '10.126.2.101', 'port': '9200'}])>,)
└ <function OpenSearch.search at 0x7fe9d59ed3f0>
File "/usr/local/lib/python3.10/site-packages/opensearchpy/client/__init__.py", line 1544, in search
return self.transport.perform_request(
│ │ └ <function Transport.perform_request at 0x7fe9d59b5750>
│ └ <opensearchpy.transport.Transport object at 0x7fe9d4c66aa0>
└ <OpenSearch([{'host': '10.126.2.101', 'port': '9200'}])>
File "/usr/local/lib/python3.10/site-packages/opensearchpy/transport.py", line 407, in perform_request
raise e
File "/usr/local/lib/python3.10/site-packages/opensearchpy/transport.py", line 368, in perform_request
status, headers_response, data = connection.perform_request(
│ └ <function Urllib3HttpConnection.perform_request at 0x7fe9d59a6440>
└ <Urllib3HttpConnection: https://10.126.2.101:9200>
File "/usr/local/lib/python3.10/site-packages/opensearchpy/connection/http_urllib3.py", line 275, in perform_request
self._raise_error(
│ └ <function Connection._raise_error at 0x7fe9d61ffac0>
└ <Urllib3HttpConnection: https://10.126.2.101:9200>
File "/usr/local/lib/python3.10/site-packages/opensearchpy/connection/base.py", line 300, in _raise_error
raise HTTP_EXCEPTIONS.get(status_code, TransportError)(
│ │ │ └ <class 'opensearchpy.exceptions.TransportError'>
│ │ └ 400
│ └ <method 'get' of 'dict' objects>
└ {400: <class 'opensearchpy.exceptions.RequestError'>, 401: <class 'opensearchpy.exceptions.AuthenticationException'>, 403: <c...
opensearchpy.exceptions.RequestError: RequestError(400, 'search_phase_execution_exception', 'failed to parse date field [$(tasks.get-date.results.date)T00:00:00.000Z] with format [strict_date_optional_time]: [failed to parse date field [$(tasks.get-date.results.date)T00:00:00.000Z] with format [strict_date_optional_time]]')
Edited by Oskar Drenske