Autocomplete returns wrong results

[kouralex]

At which URL did you encounter the problem?

http://finto.fi/lexvo/fi/

What steps will reproduce the problem?

1. Go to URL
2. Search for "espa"
3. There is an additional result from Filipino language (fil) in addition to the normal Finnish results, see attached picture below:
   

Note that the content language for search is Finnish. It seems like the SPARQL query for fetching the results is not specific enough (it returns fil, too). I think what we want is that the result should show only the language chosen + additionally the sublanguages for that language (e.g., en-GB, en-US).

[osma]

Probably this line in JenaTextSparql.php:

https://github.com/NatLibFi/Skosmos/blob/master/model/sparql/JenaTextSparql.php#L51

The challenge here is that the condition should match e.g. fi and fi_FI but not fil. Currently the language tag fi becomes the condition lang:fi* which matches also fil.

But Lucene query syntax doesn't have an obvious way to do that using a single condition (regular expressions are not supported). One option would be to split the condition into something along the lines of text:fi OR text:fi_*.

[kouralex]

Just noticed that this issue affects also the alphabetical index for lexvo.

[osma]

Another solution would be to add a FILTER(langMatches(...)) condition to the query, to filter away the improperly matched languages.