Error when searching affiliations: too_many_nested_clauses

[ntarocco]

TransportError(500, 'search_phase_execution_exception', 'too_many_nested_clauses: Query contains too many nested clauses; maxClauseCount is set to 1024')

Request: '/api/affiliations?size=20&suggest=The+Barcelona+Institute+of+Science+and+Technology'

Search params:

{page: 1, size: 20, sort: 'bestmatch', suggest: 'The Barcelona Institute of Science and Technology'}

Partial query:

{"query":{"bool":{"filter":[{"bool":{"must_not":[{"terms":{"tags":["unlisted"]}}]}}],"should":[{"multi_match":{"query":"The Barcelona Institute of Science and Technology","fields":["acronym.keyword","acronym","name","aliases","title.en","id","identifiers.identifier","country","country_name","types"],"operator":"and","type":"cross_fields","boost":3}},{"multi_match":{"query":"The Barcelona Institute of Science and Technology","fields":["acronym.keyword^50","acronym^10","name^10","aliases^5","title.en^2"

{error: {failed_shards: [{"index":"'cds-rdm-prod-affiliations-affiliation-v2.0.0-1728558302'","node":"'hGnt4dq-T66FzzECMrjZNg'","reason":"{'type': 'too_many_nested_clauses', 'reason': 'too_many_nested_clauses: Query contains too many nested clauses; maxClauseCount is set to 1024'}","shard":"0"}], grouped: True, phase: 'query', reason: 'all shards failed', root_cause: [{"reason":"'too_many_nested_clauses: Query contains too many nested clauses; maxClauseCount is set to 1024'","type":"'too_many_nested_clauses'"}], type: 'search_phase_execution_exception'}}

this Sentry excp

[sakshamarora1]

This is happening because we are using wildcard search on the title subfields. Also, the recent changes increase the number of clauses. Currently, we have 126 languages in cds-rdm which means each new word in the search query increases the clauses because of the n-gram analyzer.

Also, bit weird but I did some trial and error on what works and what doesn't:

The In of Sci and te

Even this query gives an Internal Server Error, while other queries of similar length and words work fine. Something to investigate into further...