Beta Project Report Cards

At the end of a Beta Project, we’d like to let people know how the trial went, what we measured, how feedback and suggestions were taken into account, and what the outcomes of the trial are going to be.

We’re calling this idea a ‘Beta Project Report Card’ and we’ve prepared two examples below.beta_sketch3-1

If commenting on social media please add #ReportCardBeta to help us follow what you think of the idea, and all feedback and suggestions!

As the traffic light box artworks have just recently been adopted as a solution, and will be rolled out to 200 boxes in the city, below is an initial stab at how we might report to citizens what was the outcome of that trial, and on what basis that conclusion was reached.

This is a follow up to the 1% Metrics blog post where we discussed what a local authority might measure in order to assess whether a trial worked.

(As always, this is an early and dirty version so that we can, as always, hear your immediate thoughts and suggestions. For that reason, we’ve purposefully left them pretty basic – the below were simply done in Word and Powerpoint – so that it’s easier for you to feel that you can suggest changes or to comment.)

Beta Project Report Card – Summary Type

This is an example of the type of sign that we’ve printed off at A4 size, laminated, and put onto the 11 traffic light boxes where the trial took place.

Traffic Light Boxes Report Card - Public - SummaryClick on the image to open the report.

These summary Report Cards serve two purposes:

  1. Many (probably most) people will simply be interested in a brief summary and what the outcome of a trial was…and importantly, what’s next! This summarises a trial for those people, and if they’d like to find out more, they can choose to read the more-detailed report below.
  2. Not everyone is on social media, or uses email as a regular communication tool. As a City Council, we need to be including as wide a range of citizens as possible…so the idea is that these might be printed off and put up at the location where the trial took place, and so a summary format is best.

street sign 2 - results

Beta Project Report Card – More Detailed

This is an example of what a more detailed ‘Beta Project Report Card’ might be like. It generally would only be available online (though some copies might be printed off in certain situations…but the ‘default’ would not be to spending time and money on prints).

Traffic Light Boxes Report Card - Public
Click on the image to open the report.

They present the outcome as one of 4 possible recommendations:

  1. Push
    • Solution would appear to work. Push to Consent stage to begin to develop the necessary corporate policy.
  2. Persevere
    • Need for further learning. Persevere, and develop another iteration of the trial.
  3. Pivot
    • Need to reconsider the initial aim and direction. Pivot, using learnings gained to date.
  4. Pull
    • Solution does not appear to work. Pull it, and look for other solutions.

When should Report Cards be issued?

With regard to the traffic light box artworks Beta Project there was a period when the trial had finished and been ‘removed’ (the boxes repainted grey), but it hadn’t yet formally been given the go-ahead (planning, arts office, traffic department, area offices, and so on)…so people wondered about what was the status of the project.

It threw up the question for us as to whether a Report Card should be done…

  1. Immediately at the end of the trial and irrespective of the outcome…
    • Would be at a stage when some technicality might still crop up which could prevent it going ahead, but would be sooner for people and when the trial was fresher in their minds.
    • We wouldn’t yet know what the next steps would be, so would need to tell people that separately.
    • This would make most sense in terms of some projects requiring further trialling as we’d simply announce our measurements and why we think it needs another trial iteration to learn more.
  2. Or whether we should hold off until we had a complete update for people…
    • So wouldn’t be giving potentially false hope.
    • And could announce the next steps at the same time.

We’d love to hear your feedback and suggestions please!

  1. What do you like / not like about these?
  2. What would you like to see more of / less of?
  3. What changes would you suggest?
  4. When do you think we should issue them?
  5. We’re calling them ‘Beta Project Report Cards’ as a working title. What do you think…would you suggest a different name?
  6. Any other thoughts?

(It’s worth noting here, that the traffic light box artworks was the very first Beta Project, so many of the ‘measurements’ in these report cards are often of the more qualitative rather than quantitative type. We’ll also blog our more recent thoughts on this aspect soon.)

Update: 19/09/15

Regarding the ‘When should Report Cards be issued?’ section above, the current method of including the ‘What’s Next’ within the Report Card isn’t quite working – there’s too much of a lag between the end of the trial and issuing the Report Card.

So Report Cards will now reflect method 1 above, and will be issued very quickly after the end of the trial and will simply give ‘the results’, rather than ‘the results + the decision’. Ie they will separate the reporting aspect from the decision making aspect.

Update: 21/09/15

As the Beta Projects concept is becoming more known, the number of people giving feedback is also greatly increasing. Rather than list all comments (as we usually have to date), future Report Cards could just give a few as samples, and link to the remainder in the cloud (such as a Google Doc) in order to maintain transparency and to reduce natural bias which could occur when only including a selection of all feedback received.

About Dublin City Council beta

Dublin City Council are trying a new method called DCC Beta Projects...your input, then quick trials 'on the street', then your feedback! We'd LOVE your help!
This entry was posted in 1. Identity, Communication & Ownership, Beta Project macro, Shane, Strategy and tagged . Bookmark the permalink.

26 Responses to Beta Project Report Cards

  1. John conroy says:

    i worry about things like report cards as reaction to art works like the traffic boxes that were done earlier is an emotional reaction. Here we are looking for a complicated cold analytic record or response. It needs to capture the immediate response and the long term reflective response. The reflective response can be captured through social media. Not everyone fills in hard copied reports in the same way that all people don’t use social media. Will think about a better responsive method of recording

    • Hi John, you may be misunderstanding this idea – it’s not a form for people to fill in, it’s a summary of the project for people at the end of the trial. Click on the above images to see more detail.

      So they might include (link to) social media, video, reports, utility bills (eg an energy-related trial), street conversations, expert opinions, etc.

      Interesting re immediate v long-term-reflective…we must think about those aspects.

  2. Linda O'Nolan says:

    I think it is a great idea to develop a model for getting feedback about things that citizens consume but have little choice about consuming – bicycle stands on the street and new pedestrian paving on Grafton St are important ones that spring to mind.

  3. Ex post evaluation is something that is not done nearly enough. It would be good to see this done on major projects, to compare the anticipated benefits with the actual outcome.

  4. The idea is great, improving the city while showing the hard pressed taxpayer how money is being spent and its benefits. Report card is very clear. I wish you the best of luck with your work

  5. Pingback: Report Card – Traffic Light Box Artworks | Dublin City Council Beta Projects

  6. Pingback: Report Card – Curated Walls | Dublin City Council Beta Projects

  7. Pingback: Why are Beta Projects removed? | Dublin City Council Beta Projects

  8. Pingback: Report Card – Street Parklet | Dublin City Council Beta Projects

  9. David says:

    I love this idea and I have heard people talking about the Capel St one. I’ve really wanted to look into creating something similar on Pearse st. The back side of Trinity is such a dead space and could benefit from some greenery and a bit of colour. Are you looking for volunteers?

  10. Pingback: Beta Fair Time | Dublin City Council Beta Projects

  11. Pingback: Rain Box Planters | Dublin City Council Beta Projects

  12. Pingback: LEAP points | Dublin City Council Beta Projects

  13. Pingback: 1% Metrics | Dublin City Council Beta Projects

  14. Pingback: Time to Hibernate | Dublin City Council Beta Projects

  15. Pingback: Report Card – Bike Hangar | Dublin City Council Beta Projects

  16. Pingback: Report Card – Street Parklet (iteration 2) | Dublin City Council Beta Projects

  17. Pingback: Report Card – Collaborative Working Room | Dublin City Council Beta Projects

  18. Pingback: Report Card – Rain Box Planters | Dublin City Council Beta Projects

  19. fishbone says:

    hi I am trying to find out how to nominate a traffic box we are across the road from the wooden bridge in clontarf d 3 and can’t seem to find out how to contact anyone there was recently a traffic box in Killester d 5 recently completed which is fab thanks niamh

What do you think? We'd love to hear feedback! :)

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s