Slow import process (w/ lots of variants)
If you will find the problem with long time during import products process, check process method in ProductProcessor. We override it and created ProductProcessor2 for PCMT_XLSX_PRODUCT_IMPORT job.
// HERE IS THE PROBLEM WITH LONG LOADING DATA
// $violations = $this->validateProduct($product);
//
// if ($violations->count() > 0) {
// $this->detachProduct($product);
// $this->skipItemWithConstraintViolations($item, $violations);
// }
// END HERE IS THE PROBLEM WITH LONG LOADING DATA
Out of memory error in import
- That to avoid the previous memory issues, we can change the the # of products processed in batches during import (e.g. default is 100, so we could bump it down to 10). You need to override pim_job_product_batch_size parameter which declaration you can find in vendor/akeneo/pim-community-dev/src/Akeneo/Platform/config/pim.yml
ElasticSearch rise Errors::Forbidden: [403] {"error":{"root_cause":[{"type":"cluster_block_exception","reason":"blocked by: [FORBIDDEN/12/index read-only / allow delete (api)];"}
This happens because ElasticSearch is supervising total allocated disk space. Sometimes it may cause unexpected errors. When ES detects low disk space (even if it isn't low though) it switches into flood mode and prevents from further indexing. If freeing up space doesn't help, change settings on ES instance, by issuing:
curl -XPUT -H "Content-Type: application/json" http://localhost:9200/_cluster/settings -d '{ "transient": { "cluster.routing.allocation.disk.threshold_enabled": false } }'
curl -XPUT -H "Content-Type: application/json" http://localhost:9200/_all/_settings -d '{"index.blocks.read_only_allow_delete": null}'
if the Response is: {"acknowledged":true,"persistent":{},"transient":{"cluster":{"routing":{"allocation":{"disk":{"threshold_enabled":"false"}}}}}}
then try to run process (i.e indexing) again.