Skip to content
Snippets Groups Projects
Select Git revision
  • renovate/major-opa
  • spike/go-tools-124-gql
  • spike/go-tools-124
  • main default protected
  • chore/deepmap
  • docs/mas
  • build/notify
  • fix/du
  • defect/diff
  • defect/json
  • chore/schema
  • feat/diff-json
  • chore/typo
  • build/binaries
  • build/changelog-
  • defect/otel
  • chore/otel
  • chore/dep
  • docs/changelog
  • defect/changelog
  • v0.115.3 protected
  • v0.115.2 protected
  • v0.115.1 protected
  • v0.115.0 protected
  • v0.114.0 protected
  • v0.113.5 protected
  • v0.113.4 protected
  • v0.113.3 protected
  • v0.113.2 protected
  • v0.113.1 protected
  • v0.113.0 protected
  • v0.112.0 protected
  • v0.111.1 protected
  • v0.111.0 protected
  • v0.110.2 protected
  • v0.110.1 protected
  • v0.110.0 protected
  • v0.109.0 protected
  • v0.108.0 protected
  • v0.107.0 protected
40 results

generate.go

  • Jamie Tanna's avatar
    9c679eb1
    Introduce a smaller Renovate DB query for generating data · 9c679eb1
    Jamie Tanna authored
    As noted in #73, we've got a few cases where we're fetching the whole
    set of dependencies we've got across the database, but only using a
    subset of the data, which can be duplicated between other rows.
    
    We can replace this by doing a `SELECT DISTINCT` query for only the
    fields that are necessary.
    
    Unfortunately we cannot change this for `endoflifedate.Generate` (as
    highlighted in #80).
    
    For a - larger - dataset I'm testing against, this reduces from ~73k to
    ~16k rows being checked, which significantly improves performance,
    especially taking into account the way these are then used for HTTP
    calls.
    
    For now, we can directly depend on the
    `renovatedb.RetrieveDistinctPackagesRow` struct, but would likely want
    to break this dependency by adding a layer of abstraction in the future.
    
    Closes #73.
    9c679eb1
    History
    Introduce a smaller Renovate DB query for generating data
    Jamie Tanna authored
    As noted in #73, we've got a few cases where we're fetching the whole
    set of dependencies we've got across the database, but only using a
    subset of the data, which can be duplicated between other rows.
    
    We can replace this by doing a `SELECT DISTINCT` query for only the
    fields that are necessary.
    
    Unfortunately we cannot change this for `endoflifedate.Generate` (as
    highlighted in #80).
    
    For a - larger - dataset I'm testing against, this reduces from ~73k to
    ~16k rows being checked, which significantly improves performance,
    especially taking into account the way these are then used for HTTP
    calls.
    
    For now, we can directly depend on the
    `renovatedb.RetrieveDistinctPackagesRow` struct, but would likely want
    to break this dependency by adding a layer of abstraction in the future.
    
    Closes #73.
Code owners
Assign users and groups as approvers for specific file changes. Learn more.
generate.go 2.55 KiB