Cannot see gitlab on gitlab.com when we search in productivity/cycle analytics

Currently, it seems that gitlab.com doesn't use elastic search, so we cannot find GitLab (EE) in the dropdown even if we increase the list to 50 since we rank it lower and don’t do exact matching. We should figure out a solution to implement.

@ahegyi's proposal is to sort by last_activity_at, as seen in Slack:

mikelewis Sep 18th at 7:02 PM I don't see the gitlab project listed here. Is it because the data is still being migrated? Screen Shot 2019-09-18 at 7.59.41 PM.png Screen Shot 2019-09-18 at 7.59.41 PM.png

Brandon L 5 days ago Here is an MR which fixes the issue: !16814 (merged)

Brandon L 5 days ago It’s currently live on staging and should be on production soon

virjinia 5 days ago Unfortunately, you won't be able to see it in prod as our search and ordering seems quite strange. We extended to 50 items, but on prod you still cannot see GitLab as we do not provide the exact matches in search first for some reason. You can find GitLab FOSS, though

virjinia 5 days ago @mwortschack will be thinking of a long term fix for this

mwortschack:gitlab: 5 days ago We should probably consult BE as well. I think if you type gitlab the response should include this as well. From a user perspective you cannot be more specific than typing the full name. I wonder why this isn't included in the API response. @ahegyi Can you help investigate?

ahegyi 5 days ago is there a way to load more records as user scrolls down?

mwortschack:gitlab: 5 days ago Technically yes. @brandon L We currently don't have endless scrolling in our dropdowns, right?

mwortschack:gitlab: 5 days ago Nevertheless, why is gitlabnot included in the response? It's a full match. How match the user input to the results?

ahegyi 5 days ago in the DB we search for: "gitlab*". The results are not ranked at all. They are pulled from the DB, probably ordered by the id (creation time)

ahegyi 5 days ago if we'd use a full-text search engine, like elasticsearch, the exact match would rank "gitlab" to the first place

mwortschack:gitlab: 5 days ago Ah that makes sense. Thanks for the explanation.

ahegyi 5 days ago order_by param might work

ahegyi 5 days ago order_by=last_activity_at

ahegyi 5 days ago seems like a reasonable choice

ahegyi 5 days ago https://docs.gitlab.com/ee/api/projects.html#list-all-projects

mwortschack:gitlab: 5 days ago That would be an easier fix than introducing endless scrolling in the dropdown I think? (edited)

ahegyi 5 days ago this would rank GitLab project higher

mwortschack:gitlab: 5 days ago Yap, which is exactly what we want

mwortschack:gitlab: 5 days ago At least as a temp fix

ahegyi 5 days ago won't solve the problem 100%

ahegyi 5 days ago https://gitlab.com/api/v4/groups/9970/projects.json?search=gitlab&per_page=50&with_shared=false&order_by=last_activity_at

ahegyi 5 days ago 3rd place

mwortschack:gitlab: 5 days ago still, at least it shows up

ahegyi 5 days ago yep

virjinia 5 days ago Should I create an issue? How do people search for projects now on the homepage? They always have to order and click through the pages? Verizon has 50,000 projects and I am not aware of them not being able to find their projects (edited)

virjinia 5 days ago https://gitlab.com GitLab The first single application for the entire DevOps lifecycle - GitLab “From project planning and source code management to CI/CD and monitoring, GitLab is a complete DevOps platform, delivered as a single application. Only GitLab enables Concurrent DevOps to make the software lifecycle 200% faster.”(211 kB)

ahegyi 5 days ago having a proper group/subgroup structure makes it easier

ahegyi 5 days ago also good naming conventions

mwortschack:gitlab: 5 days ago We only have this problem since a few days

mwortschack:gitlab: 5 days ago After we renamed gitlab-ee to gitlab

mwortschack:gitlab: 5 days ago 😞

mwortschack:gitlab: 5 days ago Bad timing

virjinia 5 days ago yeah, I guess most customers won't have a project called like their company

mwortschack:gitlab: 5 days ago Yeah, at lest they will have prefix/suffix in most cases

mwortschack:gitlab: 5 days ago Can you create two issues for this @virjinia? One for Cycle Analytics and one for Productivity Analytics? I guess this affects both?

virjinia 5 days ago Yes, so we will go with ordering by last updated? I thought gitlab uses elastic search for searching?

ahegyi 5 days ago unfortunately, it doesn't 😞

mwortschack:gitlab: 5 days ago I thought so too ... 😞

virjinia 5 days ago Hm, so what are we talking about here: https://docs.gitlab.com/ee/integration/elasticsearch.html

ahegyi 5 days ago AFAIK not enabled on .com

Example Screen_Shot_2019-09-18_at_7.59.41_PM

EDITED 2019-09-24 by @djensen to replace Slack link with actual Slack text, as Slack links become defunct in 90 days.

Edited by Dan Jensen