Testing checklist for new releases
Summary:
Lists some areas to test just before Inkscape is released to avoid major errors getting into the release.
Previous issues
Since the 1.0 release we've had to re-release Inkscape multiple times to fix large errors that were not caught. For example on Windows:
- 1.0.2 had broken pdf export of text due to a cairo update (inkscape#2190 (closed))
- 1.1.2 (and 1.2alpha? I don't recall) had the same issue as above (inkscape#3203 (closed))
- 1.2 had a dataloss bug in export dialog that usually would go unnoticed until reopen (inkscape#3600 (closed))
- caused an early 1.2.1 release instead of a repackaging.
- 1.2.1 had a broken Extension Manager due to a new dependency (inkscape#3695 (closed))
- 1.2.2 had crashing on-canvas text due to a missing patch in our internal cairo (which had to be changed last minute due to an upgrade in another package) (inkscape#3990 (closed), prompting this list inkscape#3990 (comment 1200107909))
We also had an issue recently in our ppa with submodules not being updated (since they had to be updated outside of the inkscape repo.
Areas to Test
Should be done separately for each platform.
Basic tests
- All dialogs at least open and work (US, German locale)
- All tools at least work (US, German locale)
- Text should work! Non-flowed text (create by a click), auto-flowed shape-inside text (create by click-and-drag), auto-flowed fixed width text (created by dragging the bottom-right handle for non-flowed text), text on a path.
- Importing, embedding, linking images works.
- Copy/paste works. Check with gradients, text, LPEs, paths within a document, between documents, and to an external application
- Undo/redo works
- Raster extensions work, Render extensions work (try 2 of each)
- Other extensions work (try eps import, a couple render extensions)
Reactions to bugs we've had before
- Any new features (please add them to the release checklist for future releases too)
- Extension manager can install an extension, clipart import can import a clipart from OpenClipart.
- Snapping works, doesn't crash
- Tutorials open and look normal (found via the Help > Tutorials sub-menu)
- Windows installer, about screen, welcome screen show intended version/image
- pdf save/export works (with text), including multi-page documents. Check in external pdf reader, and check font list per the pdf's document properties (xreader on Linux, Adobe Reader on Windows both provide this feature). Also try 454.svg
- Markers, gradients, patterns, clips, masks, symbols can be applied and remain on saving and reopening the document.
- Export dialog, save as dialog both work with multiple file formats (try with file of some complexity).
- @nemanov_oo offered to check clicking to select works on wmii before a new release (inkscape#2801 (closed)).
- Grids, guides, document with checkerboard render properly.
This should be in the automated test suite.
- Command line exports should work
- Opening a variety of old files
- Boolean operations work on pairs of items, and groups of items, and text (should be covered by test suite rather than human testing). Note, may not be fully supported yet as of now.
Note also that the automated/unit tests are not lethal on Windows.
Updates:
If you can edit it, please edit the description to update/refine the above list, rather than commenting with suggestions or requests to edit. Example files of moderate complexity would be helpful to link to here as well. If the discussion gets too large, I'd suggest opening a new issue and closing this one (and linking the issues together)
Above list still wouldn't have caught the dataloss bug.