Existing Search Issues - Triage & Grouping
## Phase 1 (before midterm)
These get fixed automatically as part of our core work. No extra effort needed, just verify during testing.
| \# | Title | Solved by |
|----|-------|-----------|
| #1900 | MySQL brought to a halt | Incremental indexing replaces the nightly full rebuild |
| #2018 | Searching for Schoyen doesn't bring up Schøyen | Diacritics normalization in the document builder |
| #1962 | OpenSearch description | Part of OpenSearch Setup |
| #1882 | Search new filters meta issue | Mapping cleanup (removing ignore_above:256) |
| #1909 | Follow-up from "Add fields and filters to search index" | Same mapping cleanup |
| #1492 | For some texts, the obv/rev cannot be extracted | Verify during ATF parser testing |
| #1894 | search not finding a word in a text | Verify during builder comparison test |
---
## Phase 2 (after midterm)
### Bugs
| \# | Title | What's needed |
|----|-------|---------------|
| #1685 | show 1000 per pages for less than 1000 results gives error | Pagination bug in ElasticSearchPaginator |
| #2138 | Invalid Unicode in URL parameter escapes breaks search | Input validation in SearchController |
| #1535 | Queries that give an error | Error handling, ties into graceful degradation work |
| #1922 | search results sorting issue | Check ElasticSearchQuery::orderBy() |
| #1640 | Exporting JTF from search fails if no artifacts have text | Edge case in export |
| #1881 | free search pub issue | Publication search in free text mode |
### Small UI fixes
| \# | Title |
|----|-------|
| #1344 | citation button and div not visible on search results pages |
| #1937 | publications comma display |
| #1537 | more button when nothing in the options |
| #1651 | link to entities index from advanced search labels |
| #313 | Adding brief explanation for each input field |
| #1755 | Show seal and composite number and seals and composites in places |
### ATF / transliteration query
| \# | Title |
|----|-------|
| #1479 | Search: tag transliteration lines with object, structure info from ATF |
| #1604 | When user searches in transliteration, tell them how many occurrences |
| #1971 | ATF @ modifiers in transliteration search |
| #2040 | Searching regex or wildcard in translation does not highlight results |
### Sign permutation (related, should be investigated)
| \# | Title |
|----|-------|
| #1521 | permutation |
| #1532 | Long sign permutation for queries |
| #1851 | sign reading permutation issue |
| #1893 | sign permutation issue: error instead of results |
| #2285 | Sign permutation limited due to max_regex_length |
### Feature requests (lower priority)
| \# | Title |
|----|-------|
| #1808 | New advanced search field: P number range |
| #1916 | Extending sort by seal number to impressions too |
| #1806 | In the advanced search, box to paste more P no than the URL can handle |
| #1886 | ElasticSearch: more than 10000 results |
| #1616 | search with unknown text values |
| #1945 | new annotations tags |
| #1951 | new advanced search field |
| #1188 | Full downloads for indices and search results |
| #2234 | TSV token list exports for search results |
| #1852 | search highlighting improvements |
### Not prioritized for GSoC
| \# | Title |
|----|-------|
| #755 | JS non invasive auto-complete or drop down for certain entities in search |
| #863 | Statistics of search results |
| #1457 | New search: improvements to commodity visualisation? |
| #1470 | page through search results |
| #1533 | Simplify search URLs |
| #1534 | Improve support for JS-less browser for search filters |
| #1816 | Free search accessibility |
| #1955 | How can we tell the users they can do an empty search? |
### OpenSearch validation checklist:
- [ ] #1900 - MySQL brought to a halt
- [ ] #2018 - Searching for Schoyen doesn't bring up Schøyen
- [ ] #1962 - OpenSearch description
- [ ] #1882 - Search new filters meta issue
- [ ] #1909 - Follow-up from "Add fields and filters to search index"
- [ ] #1492 - For some texts, the obv/rev cannot be extracted
- [ ] #1894 - search not finding a word in a text
task