Support Sessions: How We Manage Bug Reporting

Tune in every month for support team insight

Digital products have come a long way and so many teams are more agile than ever before. With continuous delivery, quick turnarounds and back-to-back release dates, running into production bugs every now and then is natural. At Marvel we, the support team, have developed a fool proof bug reporting method to help you squash those bugs in double time. ๐Ÿ›๐Ÿ”จ

Investigate it ๐Ÿ•ต

Firstly, we investigate the issue and try to replicate it on our side. If replication isn’t possible we aim to fill a report with as much useful information as possible, by asking a sequence of questions to whoever spotted the bug.

Write it ๐Ÿ–Š

Next, we collate this information in a report. One of the things that helps us to resolve bugs quickly, is speaking to developers in a language they can understand, so we use the following template to help describe each issue:

Description of bug
We write a helpful description of the problem. The more information, the easier it is for the development team to get an understanding of the issue, but we like to keep this straight to the point, no waffling here!

Steps to recreate bug:
Create an ordered list of each step taken to recreate the bug. For example:

  1. Go to download menu
  2. Click on iOS
  3. Download does not start

Expected Result
How we expect this to work

Actual Result
How the feature is (mis)behaving

URL
Include a link to the effected project/screen/account area

Code reference:
Reference to browser console and network errors

Video/screen shot:
If we can replicate the bug, we’ll pop a screen shot/recording in

Environment, Browser and OS version:
The browser & operating system the bug is happening on

Scale
When checking this bug, we include information on how many people this is effecting – this helps when prioritising!

Prioritise it ๐Ÿšจ

Once we’ve written up a bug report, we can set the priority. To help with this we use a matrix system that explains the impact and severity on a scale of 1-5. We assign a priority rating of P1, P2, P3 & P4, with P1 being the highest priority and P4 assigned to smaller issues, we then submit the bug to be prepared for discussion.

At Marvel, only P1 or P2 bugs are considered when we decide what will be fixed as we find that P3 & P4 bugs tend to be picked up by regular feature updates. So, even though we still report these, we don’t discuss these with the wider team.

Discuss it ๐Ÿค”

Each week, we meet with product managers and check over the P1 & P2 backlog to see what needs to be pushed into upcoming sprints. Sprints last two weeks and are full of important feature work that we like to ship as quickly as possible, so there is a lot to compete with!

To help decide what makes it into an already busy list, we try to stick to strict fix deadlines that are assigned to priorities. These are that a P1 bug should always break a sprint to be fixed, or, be put in the next immediate sprint (up to two weeks) and a P2 bug should not spend more than 2 or 3 sprints in the backlog (up to 6 weeks).

We find that having these set rules and working from a small list of bugs in handy dashboards, allows us wider visibility of what needs to be fixed first.

Fix it ๐Ÿ› 

Wahey, the bug is now in sprint waiting it’s turn to be exterminated!

Test it ๐Ÿ‘ฉโ€๐Ÿ’ป

We trust our engineering team but to be sure that everything is working as expected, we do a run through test to check that all is resolved.

Ship it ๐Ÿš€

Now we can ship the fix and share the good news with anyone who found or experienced the bug.

Need help with a bug or question? Drop us a message.

Tech support @ Marvel

Related Posts

Letโ€™s kick this post off with a few stats: The UK design industry is 89.5% white and 60%, male. While the US design industry is 73% white and 55%, male. According to the Office for National Statistics, the estimated total population of England and Wales is 66.5million, and out of that 87.2% of the population is white and 49% are… Read More →

Guerrilla warfare: an independent group of paramilitary fighters using unconventional tactics to divide and conquer an often larger, more orthodox enemy. Guerrilla marketing: a group of extremely savvy execs using unconventional tactics to divide you from your cash and conquer your custom. (Think: the zebra crossing painted to resemble a carton of McDonaldโ€™s fries or the part unwrapped KitKat bench.)… Read More →

Prototyping has become an essential part of any design and development process for every company. Traditionally, in order to create a prototype, you actually needed to code your work, which required nearly the same cost and effort as the final product. Nowadays, designers can cut costs and save time by quickly creating prototypes that resemble the next screens of a… Read More →