Skip to content

Export regression data JSON file for easier automated consumption

Gustavo Padovan requested to merge guspadovan/regzbot:export-json into main

Hi @knurd42,

Here is a RFC for our first meaningful contribution to regzbot. We are quite interested in having a way to fetch the regression data you have and analyze it in terms of the regressions we reported from KernelCI. That way we can automate part of the follow up process and learn from regzbot any new updates for specific regression, especially when it was fixed, so we can stop caring about it. We definitely don't want to duplicate this kind of data on our side as I believe that regzbot is the standard regression tracking place in the community. We just need good ways communicate with regzbot.

The current patch in this MR is creating a json file alongside the html pages in exportweb. Below you see the current structure proposal for the json file. We can definitely iterate on the content and structure. What I put on it for now is enough for the regression tracking work we are doing at Collabora, but it can certainly be improved.

However, we will have to evolve and stabilize some API/format at some point. We are also open to experiment with the format with some hidden "non-official" json file provided by regzbot if that looks like a good option.

[
  {
    "id": 1,
    "introduced": "8a0c014cd20516ade9654fc13b51345ec58e7be8",
    "subject": "Revert \"floppy: reintroduce O_NDELAY fix\"",
    "tree": "mainline",
    "timestamp": "2021-08-30T09:20:04+00:00",
    "entry": "20210808074246.33449-1-efremov@linux.com",
    "indentified": true,
    "introduced_url": "https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?h=master&id=8a0c014cd20516ade9654fc13b51345ec58e7be8",
    "regzbot_commands": [
      {
        "command": "introduced: 8a0c014cd20516ade9654fc13b51345ec58e7be8 ^",
        "author": "Thorsten Leemhuis",
        "timestamp": "2021-08-30T09:20:04+00:00"
      },
      {
        "command": "monitor: https://lore.kernel.org/lkml/20210818154646.925351-1-efremov@linux.com/",
        "author": "Thorsten Leemhuis",
        "timestamp": "2021-08-30T09:20:04+00:00"
      },
      {
        "command": "monitor: https://lore.kernel.org/lkml/388418f4-2b9a-6fed-836c-a004369dc7c0@linux.com/",
        "author": "Thorsten Leemhuis",
        "timestamp": "2021-08-30T09:20:04+00:00"
      },
      {
        "command": "fix: c7e9d0020361 in next referred to this regression",
        "author": "Denis Efremov",
        "timestamp": "2021-08-31T02:01:46+00:00"
      },
      {
        "command": "fixed: c7e9d0020361 in mainline referred to this regression",
        "author": "Denis Efremov",
        "timestamp": "2021-08-31T02:01:46+00:00"
      },
      {
        "command": "monitor: https://lore.kernel.org/linux-block/de10cb47-34d1-5a88-7751-225ca380f735@compro.net/",
        "author": "Thorsten Leemhuis",
        "timestamp": "2021-09-20T11:29:12+00:00"
      }
    ],
    "solved": {
      "reason": "fixed",
      "commit": "c7e9d0020361f4308a70cdfd6d5335e273eb8717",
      "subject": "Revert \"floppy: reintroduce O_NDELAY fix\"",
      "url": "https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?h=master&id=c7e9d0020361f4308a70cdfd6d5335e273eb8717",
      "git_readable": "v5.15-rc1",
      "timestamp": "2021-08-31T02:01:46+00:00"
    }
  }
]

Merge request reports