1 00:00:11,270 --> 00:00:11,780 one 2 00:00:12,570 --> 00:00:15,440 as they've it's adam again it's mine's 3 00:00:17,320 --> 00:00:17,860 and 4 00:00:19,000 --> 00:00:22,180 might all not report your you expert 5 00:00:22,700 --> 00:00:25,550 and there are a couple of things about the title of the stock 6 00:00:26,250 --> 00:00:27,760 and the first one is that it 7 00:00:28,150 --> 00:00:33,140 based on my master's thesis so everything i'm gonna talk about here on is based 8 00:00:33,140 --> 00:00:35,820 on the research i do it it'd during my master's thesis 9 00:00:36,630 --> 00:00:39,440 and the actual title of my thesis this 10 00:00:40,080 --> 00:00:46,010 a bit longer than you know report your you expired it's something like support supporting 11 00:00:46,010 --> 00:00:50,060 and user reporting of human computer interaction issues than open sort supper 12 00:00:50,630 --> 00:00:54,180 and then read that this is not a what if i told you need to 13 00:00:54,180 --> 00:00:55,240 do better than this 14 00:00:58,450 --> 00:01:02,830 then and we ended up with how to not report on your you expired even 15 00:01:02,830 --> 00:01:06,450 though the i'm gonna talk and not only about how not to do it but 16 00:01:06,450 --> 00:01:11,100 also about how to do it based on what i've been looking into and what 17 00:01:11,100 --> 00:01:13,470 i've been talking with people in the community 18 00:01:14,000 --> 00:01:17,190 so let me introduce me so i'm gonna small 19 00:01:17,970 --> 00:01:23,430 i got involved you know community last year this is my second product 20 00:01:23,990 --> 00:01:28,170 i was and now for each in turn working the island 21 00:01:28,650 --> 00:01:33,090 and big you works project a so i did a redesign for to use application 22 00:01:34,000 --> 00:01:38,880 right now i'm contributing to the web seem and also to the marketing team and 23 00:01:38,880 --> 00:01:40,060 i do a lot of work and that's 24 00:01:40,610 --> 00:01:45,130 and as i said i did my master's thesis on 25 00:01:45,670 --> 00:01:51,540 how to support on users in reporting on you what's buds on user interface bugs 26 00:01:51,540 --> 00:01:57,250 user experience bugs that are actually helpful for designers actually visible for designers to work 27 00:01:58,620 --> 00:02:02,280 so what i did something up and not gonna go into a lot of the 28 00:02:02,280 --> 00:02:07,060 details of my research because they think that's gonna be boring it's a lot of 29 00:02:07,060 --> 00:02:12,860 mythological stuff so what i did they did for interviews with us designers working in 30 00:02:12,860 --> 00:02:14,630 and three an open source projects 31 00:02:14,980 --> 00:02:17,220 and found that the door indignant project 32 00:02:17,850 --> 00:02:23,290 and i also then an analysis of i hundred and forty seven bucks in big 33 00:02:23,290 --> 00:02:24,160 numbers a lot 34 00:02:24,890 --> 00:02:30,750 i will only but i don't are on usability and you why we the so 35 00:02:30,750 --> 00:02:36,420 basically what we could roughly filter as our usability and you what buttons 36 00:02:37,870 --> 00:02:43,270 based on that i came up with a couple findings about how are designers work 37 00:02:43,270 --> 00:02:49,790 with on reports and how they tackle feedback how they used it's true to work 38 00:02:49,790 --> 00:02:52,290 and an iterative designs and everything 39 00:02:52,960 --> 00:02:57,060 and by analysing a couple but they could understand a bit how we doing you 40 00:02:57,060 --> 00:02:58,690 experts apparently and 41 00:02:59,310 --> 00:03:03,920 and by comparing this to what designers told me i can understand better on what 42 00:03:03,920 --> 00:03:07,390 is the gaps that we're dealing with between what we were doing in what we 43 00:03:07,390 --> 00:03:07,930 should do 44 00:03:10,060 --> 00:03:13,440 so i'm gonna start with telling you guys why should you care why should you 45 00:03:13,440 --> 00:03:16,790 care about reporting your you what's bugs in 46 00:03:17,510 --> 00:03:20,590 well i mean why should you actually more about doing this 47 00:03:21,360 --> 00:03:25,630 and there are two reasons that i would say it's very important for you to 48 00:03:25,630 --> 00:03:29,210 report that's in a way that people can actually act upon this 49 00:03:29,730 --> 00:03:34,580 i'm right i'm i'd like to remind that i'm talking about you what's bug so 50 00:03:34,580 --> 00:03:37,640 i'm certainly arguments that are specific to this kind about 51 00:03:38,030 --> 00:03:42,190 and also i'm calling this how to not reporting you want but i think this 52 00:03:42,190 --> 00:03:43,690 is a top motes 53 00:03:43,980 --> 00:03:48,320 what's more not only able bugs and but still itself about feedback on your legs 54 00:03:48,320 --> 00:03:52,530 and then how you feel about the interfaces and the experience we have with interfaces 55 00:03:53,680 --> 00:03:55,290 so the first reason is that 56 00:03:55,810 --> 00:03:59,990 a lot of what we report "'em" but still and the feedback we both and 57 00:03:59,990 --> 00:04:05,750 google pause or two meter or you what those we use this for design evaluation 58 00:04:05,750 --> 00:04:10,310 for it are aiding and about winning hard designs are doing and how they are 59 00:04:10,310 --> 00:04:12,200 attempting the users needs and 60 00:04:13,340 --> 00:04:17,810 how exactly how our computer are we doing well with this actually attending the users 61 00:04:17,810 --> 00:04:21,090 needs is it not so we can iterate in the design and fix it so 62 00:04:21,090 --> 00:04:23,810 we can actually better serve our users 63 00:04:25,700 --> 00:04:29,360 the next you should be comic 64 00:04:29,850 --> 00:04:33,840 that i think it's a good example one why you should evaluate and be attentive 65 00:04:33,840 --> 00:04:36,590 and concentrate about our users needs and 66 00:04:37,550 --> 00:04:42,010 people about lighting in being cautious about your design pages 67 00:04:42,350 --> 00:04:47,660 things on average think everybody that has been university can 68 00:04:48,010 --> 00:04:52,170 and relate to this that you university website they're pretty much useless you can never 69 00:04:52,170 --> 00:04:55,650 find what you need or if you can find you have to make it 70 00:04:56,360 --> 00:04:57,830 small quest to find it 71 00:04:59,110 --> 00:05:01,840 so i guess that's what happens and that happens because that 72 00:05:02,560 --> 00:05:09,650 there is a considerable gap between what the person that is actually conceiving a design 73 00:05:09,650 --> 00:05:13,620 and the person that is actually using the design this order person can see there 74 00:05:13,620 --> 00:05:17,610 is a gap year and even not worth designs they study a lot and they 75 00:05:17,610 --> 00:05:22,510 work i want to make this got them in as minimal as possible this it 76 00:05:22,510 --> 00:05:27,380 there is there is going to be this gap and that's why it's really important 77 00:05:27,380 --> 00:05:30,050 first to evaluate so we can understand the ways and people 78 00:05:30,670 --> 00:05:32,060 they are using i mean 79 00:05:32,370 --> 00:05:35,960 you never know when you do some usability testing or when you know 80 00:05:36,400 --> 00:05:42,130 whatever kind of evaluation you never know you you're always surprised about how people appropriate 81 00:05:42,130 --> 00:05:46,150 themselves of technology and the way is the you soft are always like i'd never 82 00:05:46,150 --> 00:05:51,910 talked about using this a preferred to this thing and it's always amazing how unexpected 83 00:05:51,910 --> 00:05:55,520 things from to come up come to surface when you when you without which are 84 00:05:55,520 --> 00:05:56,540 designs with users 85 00:05:58,320 --> 00:06:01,030 so about evaluation method itself 86 00:06:01,590 --> 00:06:06,650 i think that most people want to talk about waiting on what they think about 87 00:06:06,650 --> 00:06:10,890 usability testing straightaway it's the first thing that pops into amount i think people are 88 00:06:10,890 --> 00:06:15,060 very passionate about usability testing they really enjoyed and 89 00:06:16,010 --> 00:06:18,800 the first thing that comes to my and it turns out that 90 00:06:19,540 --> 00:06:21,050 use with lasting is not 91 00:06:21,880 --> 00:06:25,730 the only way to really and speak about free an open source operand how we 92 00:06:25,730 --> 00:06:30,470 work and how with about some great how we created and how we how hard 93 00:06:30,470 --> 00:06:34,070 really cycle is actually is ability this is not quite 94 00:06:34,550 --> 00:06:38,670 suitable for how we work it takes a lot of time 95 00:06:39,200 --> 00:06:43,090 onto plan to execute to analyse the data collected 96 00:06:43,650 --> 00:06:48,430 and it turns out that see as you wanna are really cycle is very short 97 00:06:48,430 --> 00:06:52,120 so by the time we plan the usability testing in the previous versions they have 98 00:06:52,120 --> 00:06:57,170 an owl triplicate we already released people and perhaps even people twelve 99 00:06:57,530 --> 00:06:58,090 and 100 00:06:58,700 --> 00:07:03,570 so it's actually not very suitable for our names it's all those about a lot 101 00:07:03,570 --> 00:07:08,930 about how the problems people face when you get to observe people and everything five 102 00:07:10,000 --> 00:07:16,160 i think in terms of three n-tuples of our software on usability testing is much 103 00:07:16,160 --> 00:07:20,760 more useful when you together a sense of how people wired to better know your 104 00:07:20,760 --> 00:07:25,070 users because that's a problem we will you have an open source to know who 105 00:07:25,070 --> 00:07:27,660 we're dealing it with who are reproducing so for two 106 00:07:29,210 --> 00:07:33,150 another one that's quite popular is with the voice and i think some people might 107 00:07:33,150 --> 00:07:33,980 have heard about it 108 00:07:36,050 --> 00:07:41,870 but it's a an evaluation technique that do not and will user participation on it's 109 00:07:41,870 --> 00:07:45,270 only the designer that on and what or lessons back 110 00:07:45,780 --> 00:07:51,020 the whole interface having in mind some guy right lines and then try to identify 111 00:07:51,020 --> 00:07:52,030 possible 112 00:07:52,590 --> 00:07:56,620 meatballs for users based on this and this and they're popular one but there is 113 00:07:56,620 --> 00:08:01,250 much more to evaluation methods on our user interface design 114 00:08:03,890 --> 00:08:09,970 they're dreaming categories of evolution methods the first one it's investigation methods which are and 115 00:08:09,970 --> 00:08:14,830 i was that do involve or dispassionate users but they're more okay and finding out 116 00:08:14,830 --> 00:08:19,040 to the user is what do they do one a mindset wanted to ask they 117 00:08:19,040 --> 00:08:23,420 needed to accomplish and this kind of thing so it's more like a preliminary thing 118 00:08:23,420 --> 00:08:28,500 that usually do with both like thirties questionnaires some kind of you work so you 119 00:08:28,500 --> 00:08:32,940 go to where people work where they do their task that you just observe how 120 00:08:32,940 --> 00:08:34,210 they used up 121 00:08:35,740 --> 00:08:39,920 there's also inspection methods that they said they were think evolution is an inspection method 122 00:08:39,920 --> 00:08:44,350 they usually do not in both or the speech from the user they are 123 00:08:44,770 --> 00:08:49,270 basically or one but by the designer himself and he just put himself in the 124 00:08:49,270 --> 00:08:54,760 place of the user and trying to go to think about what are the flaws 125 00:08:54,760 --> 00:08:56,590 in the design and what are the problems 126 00:08:57,370 --> 00:09:00,790 and all kind of stuff is the thing we do a lot in our community 127 00:09:00,790 --> 00:09:04,070 in them and i guess innovative other projects with 128 00:09:04,830 --> 00:09:09,510 it's especially because we have a really difficult time to find users it talk to 129 00:09:09,510 --> 00:09:11,920 them and figure out what what's happening 130 00:09:13,060 --> 00:09:18,090 and there's also observation methods which are methods that are also as a investigation methods 131 00:09:18,090 --> 00:09:20,380 they also involve participation from users 132 00:09:21,010 --> 00:09:25,910 but if you those people observing as the name says help be more useful very 133 00:09:25,910 --> 00:09:30,530 healthy are interacting of it how a they use it how the appropriate themselves of 134 00:09:30,530 --> 00:09:31,880 the technology we got hurt 135 00:09:32,610 --> 00:09:36,820 and what i want to propose here is that we think about but reports as 136 00:09:36,820 --> 00:09:42,270 a do for observation still one when i would work a problem that a experience 137 00:09:42,270 --> 00:09:45,490 that i had this is actually a way to design a can observe 138 00:09:45,680 --> 00:09:48,860 is a large expand the problems that i'm facing 139 00:09:50,340 --> 00:09:54,320 and i think that's one of the main uses of but reports from a design 140 00:09:54,320 --> 00:09:54,930 perspective 141 00:09:56,270 --> 00:09:59,300 i don't think you think about bug reports of the contribution 142 00:09:59,860 --> 00:10:00,560 and 143 00:10:02,560 --> 00:10:07,660 would you would you can to be told that for example doesn't work at all 144 00:10:07,660 --> 00:10:11,520 would you can recall that does not solve the problem that this does not fix 145 00:10:11,520 --> 00:10:12,230 an issue 146 00:10:12,780 --> 00:10:16,140 or even more is would you can to be go that only works for you 147 00:10:16,140 --> 00:10:16,450 but 148 00:10:16,920 --> 00:10:20,130 i mean only you can see that problem was fixed 149 00:10:20,500 --> 00:10:24,850 or something like that would anyone do this or at your expense a honorary the 150 00:10:24,850 --> 00:10:27,730 for product with you right implementation that only you can understand 151 00:10:28,260 --> 00:10:32,360 or i don't know would you design the software that only you can use just 152 00:10:32,360 --> 00:10:36,090 think the contribution would you would work about that no one can understand what you're 153 00:10:36,090 --> 00:10:36,850 talking about 154 00:10:38,030 --> 00:10:42,730 would you report about that only you know what you're talking about so it's really 155 00:10:42,730 --> 00:10:48,490 important that we are able to communicate well that we are able to establish use 156 00:10:48,490 --> 00:10:52,390 but reports as a as a breakfast at between are committed in different parts of 157 00:10:52,390 --> 00:10:56,580 maybe as we do with any other kind of contributions we got in our community 158 00:10:58,570 --> 00:10:59,510 so 159 00:11:00,140 --> 00:11:04,840 even having is that why you guys should care about reporting your you expect well 160 00:11:04,840 --> 00:11:07,730 i'm gonna start try telling you guys for to not do this 161 00:11:08,410 --> 00:11:11,660 and i think to begin with the first one is that a guy that a 162 00:11:11,660 --> 00:11:12,640 lot of you guys know 163 00:11:13,110 --> 00:11:18,450 and that is a quote that of all the designers are interview have mentioned in 164 00:11:18,450 --> 00:11:19,490 the exact same way 165 00:11:20,810 --> 00:11:21,020 do 166 00:11:22,150 --> 00:11:23,450 i think that should you want 167 00:11:24,290 --> 00:11:26,550 and they all raised exactly like this 168 00:11:27,230 --> 00:11:30,000 there's a very different a very 169 00:11:30,750 --> 00:11:36,620 it's very different when you say i think something should be like something else and 170 00:11:36,620 --> 00:11:40,430 when you say well i try to do one thing and then i was not 171 00:11:40,430 --> 00:11:43,690 able to do this thing and this make me frustrated or a lot a lot 172 00:11:43,690 --> 00:11:47,090 of time and i expected to do this there's other way 173 00:11:47,440 --> 00:11:49,340 and perhaps you can do this 174 00:11:49,840 --> 00:11:56,320 so it's a it's really a matter of difference rating problem and solution but report 175 00:11:56,320 --> 00:12:00,390 sort of new use if you only offer a solution so i think about when 176 00:12:00,390 --> 00:12:03,400 you go to adapt or do you go to the doctor and you say 177 00:12:04,040 --> 00:12:05,690 i have the flu 178 00:12:06,430 --> 00:12:10,440 that's it i need this and this medication know you go to the doctor and 179 00:12:10,440 --> 00:12:14,500 you say well you know maybe not really very well i have fever i have 180 00:12:14,500 --> 00:12:19,190 this in this pain and i've been not feeling very well you know what's happening 181 00:12:19,190 --> 00:12:22,980 to me and what kind of medication should you so that use you go to 182 00:12:22,980 --> 00:12:26,230 the doctor and you say this is the prescription just try to tear 183 00:12:27,210 --> 00:12:27,660 right 184 00:12:28,070 --> 00:12:29,140 so 185 00:12:29,630 --> 00:12:34,080 this is the same thing with what it's i mean you it's much helpful when 186 00:12:34,080 --> 00:12:36,560 you state the problem that you're actually facing 187 00:12:37,200 --> 00:12:43,140 and not just observe the solution and there's a lot of things that 188 00:12:43,490 --> 00:12:47,050 are also related it is i mean there is a not a minimum a number 189 00:12:47,050 --> 00:12:47,900 of reasons why 190 00:12:48,720 --> 00:12:53,590 it's really hard for designers work on but reports and feedback in general that only 191 00:12:53,590 --> 00:12:58,030 state the solution because i mean when you're bored i mean actually really nice that 192 00:12:58,030 --> 00:13:01,040 everyone wants to be a the kinder and everybody but 193 00:13:01,520 --> 00:13:07,440 sometimes people just not understand this the underlying technology what the problem we deal with 194 00:13:07,440 --> 00:13:11,030 and there's a lot of restrictions sometimes in terms of P how the cold is 195 00:13:11,030 --> 00:13:17,230 itself or actually about their design vision that's it's being taken by D by in 196 00:13:17,230 --> 00:13:20,110 general i mean overall for the project so 197 00:13:20,410 --> 00:13:23,350 there's a lot of information that sometimes people were laughing 198 00:13:23,870 --> 00:13:25,910 and that it actually makes a solution 199 00:13:26,640 --> 00:13:27,730 so 200 00:13:28,600 --> 00:13:32,670 it's okay to propose solution please don't think that i'm not saying you never you 201 00:13:32,670 --> 00:13:37,400 never services that i mean this is how we work we work together and by 202 00:13:37,400 --> 00:13:40,220 an extent i want to by giving the guidelines on 203 00:13:40,950 --> 00:13:44,870 exclude anyone from the discussions that take place i think this is just sell way 204 00:13:44,870 --> 00:13:49,450 so we can get a quick stored on the report and like this a couple 205 00:13:49,450 --> 00:13:52,720 of course because if you do not observer problem what will happen is that the 206 00:13:52,720 --> 00:13:53,920 design it will come to you and say 207 00:13:54,230 --> 00:13:58,580 okay what is exactly the problem that you're having because i mean i can just 208 00:13:58,580 --> 00:14:02,720 add this button perhaps it's not the best solution you know i mean perhaps something 209 00:14:02,720 --> 00:14:06,160 else able soldier problem better and you really don't want to solve the problem that 210 00:14:06,160 --> 00:14:07,320 is not a problem but you have 211 00:14:08,850 --> 00:14:13,780 so it's a proposal isn't as it's okay to submit a patch but i mean 212 00:14:13,780 --> 00:14:18,090 you can you one here just submit a bug with just about your slides 213 00:14:18,580 --> 00:14:19,210 apply it 214 00:14:19,820 --> 00:14:22,830 i mean that's not something we do and it's not something we should do with 215 00:14:22,830 --> 00:14:24,560 design bugs it as well 216 00:14:25,060 --> 00:14:29,270 so it's a possible solution but it should not be your main point it should 217 00:14:29,270 --> 00:14:33,270 not only be able to solution it you think it's gonna be appropriate for your 218 00:14:33,840 --> 00:14:34,150 for 219 00:14:35,230 --> 00:14:38,970 so i think this is the most important part of it let others brainstorm with 220 00:14:38,970 --> 00:14:44,410 you letter hours thing together with you use data probably and you that everyone brainstorm 221 00:14:44,410 --> 00:14:48,730 with you designers developers and everybody out that that's all still experiencing this problem they 222 00:14:48,730 --> 00:14:52,510 can see about reporting can leave a note of they i arrived in also having 223 00:14:52,510 --> 00:14:57,410 this problem with that in this order a quality or characteristic or anything and this 224 00:14:57,410 --> 00:14:59,840 is the solution and everybody can work in this together 225 00:15:00,490 --> 00:15:05,260 you know much more clear way because you you're not actually solving up you're not 226 00:15:05,260 --> 00:15:08,610 giving users what they ask for but actually what we need 227 00:15:10,410 --> 00:15:12,280 no one is it sucks 228 00:15:13,110 --> 00:15:19,420 which comes are several different forms it's comes it's broken it's an hour problem i 229 00:15:19,420 --> 00:15:20,440 don't like it 230 00:15:21,880 --> 00:15:23,870 for whatever reason i just don't like it 231 00:15:24,320 --> 00:15:25,050 it doesn't work 232 00:15:25,680 --> 00:15:29,520 L it's just doesn't i don't i don't really know what's broken but 233 00:15:30,500 --> 00:15:34,560 it's difficult and then it then the next you want they are kind of like 234 00:15:34,560 --> 00:15:37,900 this they are likely that they pretend to be nice feedback for the and actually 235 00:15:37,900 --> 00:15:38,940 not help what L 236 00:15:39,730 --> 00:15:41,060 it's not intuitive 237 00:15:41,720 --> 00:15:46,760 what is it which i mean it's just not helpful 238 00:15:47,330 --> 00:15:52,000 and it's not user friendly i think that one i mean want that to be 239 00:15:52,000 --> 00:15:56,470 evenly maybe it is just this doesn't say anything this kind of feedback it is 240 00:15:56,470 --> 00:16:00,760 not going to the pretend to be helpful but there because they don't answer as 241 00:16:00,760 --> 00:16:02,970 i said before the problem they did not say 242 00:16:03,440 --> 00:16:09,590 why in the why is it that why is it broken why in the way 243 00:16:09,590 --> 00:16:14,290 it doesn't work for you why what exactly about this whole interface you don't like 244 00:16:14,960 --> 00:16:18,850 so i mean it's very it's very easy for us when we were like we 245 00:16:18,850 --> 00:16:24,310 really upset with operates really easy first you just like the anger go with socks 246 00:16:24,310 --> 00:16:29,390 you're such an incompetent are stored but really it's not helpful and i mean we 247 00:16:29,390 --> 00:16:31,310 once problem our problems should be solved 248 00:16:31,960 --> 00:16:35,570 after all i mean we don't want to stick with terrible wouldn't experiences and terrible 249 00:16:35,570 --> 00:16:36,660 winter pieces rubber 250 00:16:37,190 --> 00:16:38,010 so 251 00:16:38,710 --> 00:16:44,330 explain why you have a certain problem why didn't exactly the problem that you have 252 00:16:45,250 --> 00:16:47,850 at least that you don't want to solve a problem that is not the problem 253 00:16:47,850 --> 00:16:48,790 that you have 254 00:16:49,600 --> 00:16:55,330 so if you just say it sucks then i can start i prototyping in which 255 00:16:55,330 --> 00:16:59,020 ways it sucks and i don't know me it sucks for me i think all 256 00:16:59,020 --> 00:17:04,390 it's probably how it sucks for him so i'm just gonna i'm just gonna focus 257 00:17:04,390 --> 00:17:05,300 problem and 258 00:17:05,750 --> 00:17:08,800 in a month or something that's gonna couples again it's not 259 00:17:09,720 --> 00:17:13,140 i'm using at or something like that i'm not using you know many more 260 00:17:15,070 --> 00:17:19,730 the aim of about report is to enable the programmer you see the program flailing 261 00:17:19,730 --> 00:17:20,660 in front of them 262 00:17:21,230 --> 00:17:25,330 this is true for a lot of callbacks so you just described much and then 263 00:17:25,330 --> 00:17:28,150 you try to and use the programmer to reproduce 264 00:17:28,860 --> 00:17:32,680 that like that you had so that you can see the problem failing are crashing 265 00:17:32,680 --> 00:17:35,900 in front of them but it's kind of tricky for you what's but because a 266 00:17:35,900 --> 00:17:40,380 lot of times that you whisper the experience problem already usability problem the really personal 267 00:17:40,380 --> 00:17:45,500 matter it it's really about how you felt about the interface always took a lot 268 00:17:45,500 --> 00:17:49,030 of time it was a to struggle like i could not use it i don't 269 00:17:49,030 --> 00:17:50,630 really competent about it so 270 00:17:51,400 --> 00:17:57,210 it's much harder to just give a designer about and an expectation to reproduce it 271 00:17:57,210 --> 00:18:01,070 to make it the to make the problem fail because the designer have a different 272 00:18:01,070 --> 00:18:07,260 experience they have a different mindset you have the different personality and that he therefore 273 00:18:07,260 --> 00:18:11,170 you definitely there and we have different to stop or 274 00:18:11,890 --> 00:18:14,000 so this prime the context 275 00:18:14,490 --> 00:18:18,550 i've been i've been helping with the i have fights working with you know my 276 00:18:18,550 --> 00:18:22,800 also which may which were dressed and i've been helping them in the forums and 277 00:18:22,800 --> 00:18:26,040 a lot of that they work that it sometimes that in different they just want 278 00:18:26,040 --> 00:18:28,120 to change customise the website somehow 279 00:18:28,470 --> 00:18:30,760 and it's a lot of C S hope and then you just 280 00:18:31,310 --> 00:18:34,650 don't have a again find some success that works for them and so their problem 281 00:18:34,650 --> 00:18:37,820 and it's really help for me when people come and see how to build the 282 00:18:37,820 --> 00:18:38,970 first thing about that 283 00:18:39,520 --> 00:18:43,590 i really don't know this thing because it really gives me a start point a 284 00:18:43,590 --> 00:18:47,080 starting point and how to talk to this user how to solve the problem for 285 00:18:47,080 --> 00:18:50,870 down and or also is different things to me like i don't know i guess 286 00:18:50,870 --> 00:18:54,090 that's what i like reading on it i've been trying to solve it but i 287 00:18:54,090 --> 00:18:57,090 think my favourite i can so this so you know this person doesn't know C 288 00:18:57,090 --> 00:18:59,460 S but he wants to know see as that 289 00:18:59,870 --> 00:19:02,950 so i can help him in a different way i usually try to explain to 290 00:19:02,950 --> 00:19:06,730 be there how to use fire about how to do certain things so it's really 291 00:19:06,730 --> 00:19:10,980 make when you provide complex when you provide information on line to do certain things 292 00:19:10,980 --> 00:19:15,100 what you how you we got to start and stop it really helps people to 293 00:19:15,100 --> 00:19:18,800 impress your problems to help you and to choose so whereabouts 294 00:19:21,450 --> 00:19:27,200 and the third one is most users most users would find this an intuitive it 295 00:19:27,200 --> 00:19:32,780 combines to present or most users i dunno wouldn't want to button to be somewhere 296 00:19:32,780 --> 00:19:33,140 else 297 00:19:33,450 --> 00:19:37,850 and i mean did you actually talk to most users did you actually like 298 00:19:38,560 --> 00:19:43,870 it up fast in your neighbourhood and you set up a most users definitely don't 299 00:19:43,870 --> 00:19:47,810 like this in my neighbourhood and then it would be able to the neighbourhood but 300 00:19:47,810 --> 00:19:49,690 not most users that all so 301 00:19:50,350 --> 00:19:54,550 expenses is that is really personal so you should really talk about yourself about how 302 00:19:54,550 --> 00:19:56,600 you feel how this 303 00:19:57,140 --> 00:20:01,430 because they're first learning convex because of all you you've been dealing with it 304 00:20:02,210 --> 00:20:06,960 why is it is it a problem for you not for most users because you're 305 00:20:06,960 --> 00:20:10,670 just assuming it's a problem for most users and it turns out that several 306 00:20:11,120 --> 00:20:16,540 it's actually a very specific use case that only you have still it's not most 307 00:20:16,540 --> 00:20:24,770 users perhaps the most users had it's very specific use case then you it's another 308 00:20:24,770 --> 00:20:30,410 thing i don't know but in general you lex is a fairly personal matter so 309 00:20:30,410 --> 00:20:35,200 you should always say i want i still i wish i struggle i think it's 310 00:20:35,200 --> 00:20:39,250 about you are experiencing that about that is that the same thing with code you 311 00:20:39,250 --> 00:20:43,750 cannot take it most it precious for most users you know i mean it was 312 00:20:43,750 --> 00:20:49,010 just for you you're using this machine you're having this kind of application running and 313 00:20:49,010 --> 00:20:53,890 whatever you have a certain encompass after nine think that only it's only britain and 314 00:20:53,890 --> 00:20:55,410 for your experience 315 00:20:57,630 --> 00:21:02,320 number of words to really minor and this is the thing and something you think 316 00:21:02,320 --> 00:21:05,170 we should review what the box watching of all right 317 00:21:06,760 --> 00:21:13,430 and think about this right now are gonna minus you i or usability and usability 318 00:21:13,430 --> 00:21:18,670 bugs not you wax as a very minor and as we want to talk more 319 00:21:18,670 --> 00:21:23,790 about our experiences i mean usability problems usually a remove something somewhere or like this 320 00:21:23,790 --> 00:21:27,910 is not consistent with something L's or we should rename this button and it's usually 321 00:21:27,910 --> 00:21:33,170 like the lack of absence of the presence or absence of a certain design characteristic 322 00:21:33,170 --> 00:21:35,710 which i understand that something minor but i mean 323 00:21:36,300 --> 00:21:39,520 alright are you what's but also ready minor issues 324 00:21:40,660 --> 00:21:44,800 it's one cannot figure out how to do something and they just are not able 325 00:21:44,800 --> 00:21:48,080 to do something is there's really it's a very have a really minor issue 326 00:21:49,130 --> 00:21:53,750 it's the not understand what system is the only know if they cannot and they 327 00:21:53,750 --> 00:21:57,140 get this message this dialogue and they have no idea what to do and how 328 00:21:57,140 --> 00:22:00,740 to recover officer dinner it is really a minor issue 329 00:22:02,540 --> 00:22:05,790 it's does not know whole to continue what that's great and that's 330 00:22:06,400 --> 00:22:09,030 it is again assume a minor issue 331 00:22:10,250 --> 00:22:15,250 it's one even more seats one something and they thought it was very successful and 332 00:22:15,250 --> 00:22:18,250 only later do you realise it was not and they were like 333 00:22:18,960 --> 00:22:23,940 but actually did it is it really a minor issue i mean you what the 334 00:22:23,940 --> 00:22:28,190 user to think he was able to accomplish something when he actually it like seems 335 00:22:28,190 --> 00:22:31,780 fine to me but it actually it user actually failed to accomplish what he was 336 00:22:31,780 --> 00:22:35,770 trying to our goals issues and i'm asking this all guys 337 00:22:36,380 --> 00:22:41,120 minor issues or is it like a block or issue a critical matter for that 338 00:22:41,120 --> 00:22:45,930 experience i mean if we are compromising the ability of things which are probably can 339 00:22:45,930 --> 00:22:46,620 do what he 340 00:22:47,510 --> 00:22:50,710 it is really a minor issue the user is not able to use the system 341 00:22:50,710 --> 00:22:51,550 to use needs 342 00:22:52,950 --> 00:22:56,710 and then well as a side i think this is should we should this is 343 00:22:56,710 --> 00:22:58,970 something we should be who was a community together 344 00:22:59,760 --> 00:23:02,790 and perhaps we should think about better i got mine sorry you want like to 345 00:23:02,790 --> 00:23:08,480 specifically for experience but because they can really compromise the whole experience and the whole 346 00:23:08,480 --> 00:23:09,180 use of soccer 347 00:23:10,310 --> 00:23:14,040 there is this is a very ratings and they have a different purpose they therefore 348 00:23:14,040 --> 00:23:19,340 so that a designer can right but on box problems feasibly problem that he found 349 00:23:19,340 --> 00:23:24,040 after doing and usability testing or something or heuristic evaluation and then write them and 350 00:23:24,040 --> 00:23:27,790 then decide what should be big first and this kind of thing so it's not 351 00:23:27,790 --> 00:23:31,620 really if something that the user or the report it uses but it's a start 352 00:23:31,620 --> 00:23:36,370 i guess so the scale is more like they're all going to reduce the problem 353 00:23:36,370 --> 00:23:42,260 too with the cosmetic horrible treats a minor issue for the major issue and five 354 00:23:42,260 --> 00:23:45,910 it's a usability catastrophe like it really compromises the whole thing 355 00:23:47,400 --> 00:23:49,220 so you know i'm gonna talk about how to do it 356 00:23:50,170 --> 00:23:56,080 and after my researcher or talking with what the designers are interview and i came 357 00:23:56,080 --> 00:24:00,880 up with a list of six information types that it would be really helpful in 358 00:24:00,880 --> 00:24:02,580 reports can include most of them 359 00:24:03,680 --> 00:24:06,920 so they are there and freezing them as questions 360 00:24:07,240 --> 00:24:10,770 and they are what are you trying to do why did you want to do 361 00:24:10,770 --> 00:24:11,090 it 362 00:24:11,590 --> 00:24:12,450 what did you do 363 00:24:13,610 --> 00:24:19,170 what exactly do you do doing but tracks and what happened what were your expectations 364 00:24:19,170 --> 00:24:20,280 and what are you running 365 00:24:21,150 --> 00:24:26,400 and again i interviewed designed it's working with open sores free open source projects so 366 00:24:26,400 --> 00:24:31,000 this is really pertinent for did there is the main on offer in general 367 00:24:31,540 --> 00:24:34,000 reporting usability guidelines or whatever 368 00:24:36,300 --> 00:24:36,890 so 369 00:24:39,060 --> 00:24:41,800 i'm gonna talk a little bit about each of this questions 370 00:24:42,090 --> 00:24:43,020 and everything is 371 00:24:43,570 --> 00:24:48,170 what we're trying to do which is also associated a bit with the problem so 372 00:24:48,170 --> 00:24:53,550 state what is it that you're actually trying to do what was your main goal 373 00:24:53,550 --> 00:24:58,460 when you started this interaction i wanted to print a file it's much more helpful 374 00:24:58,460 --> 00:25:02,360 to say i wanted to print a file then just say like insert this checkbox 375 00:25:02,360 --> 00:25:06,250 somewhere that you can be an option to do something related sprinting or something like 376 00:25:06,250 --> 00:25:06,540 that 377 00:25:07,260 --> 00:25:10,970 so this those are some quotes that i got from the designers that in their 378 00:25:10,970 --> 00:25:11,520 interview 379 00:25:12,180 --> 00:25:15,320 we try to get more information about what is it that they were trying to 380 00:25:15,320 --> 00:25:19,360 do because that has to be the drive the solution this has to be what 381 00:25:19,360 --> 00:25:23,550 guides the solution you don't you don't want to so that the problem that is 382 00:25:23,550 --> 00:25:26,230 not the problem that you have as i said many times 383 00:25:28,230 --> 00:25:29,820 why did you want to do it and 384 00:25:30,600 --> 00:25:36,930 this is a tricky question and it's not something that will be always pregnant or 385 00:25:38,270 --> 00:25:42,960 or it will not always of white your but sometimes it doesn't really make sense 386 00:25:43,450 --> 00:25:48,690 but it's a question related to the complex why want what motivates you to want 387 00:25:48,690 --> 00:25:49,570 to do certain axe 388 00:25:50,320 --> 00:25:55,790 and then that's got that comes of information is really valuable to me it helps 389 00:25:55,790 --> 00:26:01,520 me understand the motivation behind the request or sort of problem so there was an 390 00:26:01,520 --> 00:26:07,530 example that was someone was using a startup location and they want their something smaller 391 00:26:08,380 --> 00:26:09,030 and 392 00:26:09,640 --> 00:26:14,690 why would you want your compact smaller why is the reason for that and then 393 00:26:14,690 --> 00:26:19,420 the user would explain that i want my complex smaller because i have a lot 394 00:26:19,420 --> 00:26:23,260 of contacts and no not all of them have out there are so it's not 395 00:26:23,260 --> 00:26:26,150 really helpful for me to have a big i got and all that so it 396 00:26:26,150 --> 00:26:30,500 gets a lot of it get similar background that will change the way the designer 397 00:26:30,500 --> 00:26:31,600 will tackle the solution 398 00:26:32,070 --> 00:26:36,540 and it's not related to exactly what you're trying to do because what he was 399 00:26:36,540 --> 00:26:40,820 trying to do what you make a picture smaller but two related to why you 400 00:26:40,820 --> 00:26:44,070 want to walk money made it seem to want to do a certain action and 401 00:26:44,070 --> 00:26:46,520 of course if you're a i had a problem to try to connect to the 402 00:26:46,520 --> 00:26:49,570 internet why do you want to connect to the internet i mean it doesn't make 403 00:26:49,570 --> 00:26:52,640 sense to me that i wanted to get to interact so i could like would 404 00:26:52,640 --> 00:26:56,260 work picture for cats or something like that i mean it's not relevant to design 405 00:26:56,260 --> 00:27:00,950 it all and it's really hard to make this judgement on when there's this person 406 00:27:00,950 --> 00:27:03,950 and when it's not but it's something to keep in the back of your head 407 00:27:03,950 --> 00:27:05,720 when we are reported bugs 408 00:27:07,010 --> 00:27:09,560 what did you and this is about 409 00:27:10,740 --> 00:27:15,230 describing the whole thing this one happened during the whole interaction 410 00:27:15,660 --> 00:27:20,610 it's great one reports our narrative you know every interaction problem is very much like 411 00:27:20,610 --> 00:27:26,370 the story so i wanted to do this and then i tried this thing and 412 00:27:26,370 --> 00:27:30,190 then that thing happened and i didn't expect is because expected that sort of thing 413 00:27:30,190 --> 00:27:33,460 to happen and then to work around this i try to do that sort of 414 00:27:33,460 --> 00:27:38,370 thing but that didn't work too silly tells the designer everything that's you try to 415 00:27:38,370 --> 00:27:43,380 do and it might seem like a bit lost embedding when we when i ran 416 00:27:43,380 --> 00:27:48,610 some experience some studies trying to ask people to report things answering this question most 417 00:27:48,610 --> 00:27:52,490 of the time they were able to report things using like three or cricket lines 418 00:27:52,490 --> 00:27:53,450 describing 419 00:27:54,030 --> 00:27:58,710 what is it that they were to they did how the expects the whole interactive 420 00:27:58,710 --> 00:27:59,200 works 421 00:28:02,180 --> 00:28:07,130 and it's really helpful especially when you mentioned the things that you try to do 422 00:28:07,130 --> 00:28:10,600 to solve a problem this else to do this tells a lot of the designer 423 00:28:10,600 --> 00:28:16,060 about how you think and how you actually how what is your experience what's operate 424 00:28:16,060 --> 00:28:20,410 how you used to do things and brand that we do not know exactly how 425 00:28:21,000 --> 00:28:24,780 what is our user base this is really helpful is a real helpful to try 426 00:28:24,780 --> 00:28:29,050 to understand for a certain perspective on how the user is and because it really 427 00:28:29,050 --> 00:28:32,670 doesn't make sense told this is the first speaker building your report tell us we 428 00:28:32,670 --> 00:28:36,890 or what your experience in really it's not helpful still there is we have to 429 00:28:36,890 --> 00:28:38,390 find another way to understand 430 00:28:38,960 --> 00:28:41,970 so the user is and what are see experience and how we can better address 431 00:28:41,970 --> 00:28:43,120 the problems that he's facing 432 00:28:45,020 --> 00:28:49,650 so you know the very helpful this is what i wanted to do this is 433 00:28:49,650 --> 00:28:53,580 where i started this is what i did this is where a one problem and 434 00:28:53,580 --> 00:28:55,300 this is how i try to work around it 435 00:28:55,760 --> 00:29:01,400 and if you will write this and that you should never be afraid of are 436 00:29:01,400 --> 00:29:05,030 offering too much information because if you want for too much information the design there 437 00:29:05,030 --> 00:29:09,120 will just ignore that part of the information that he doesn't need so it's much 438 00:29:09,120 --> 00:29:13,070 better if you provide a lot of information then if you lack information because then 439 00:29:13,070 --> 00:29:17,290 the whole the whole processing of about becomes really time consuming you just have to 440 00:29:17,290 --> 00:29:21,510 engage with the reporter and go back and forth and try to make all those 441 00:29:21,510 --> 00:29:23,620 questions that i'm stating and 442 00:29:24,180 --> 00:29:28,050 and this takes time and then your bags gonna take longer to be solved and 443 00:29:28,050 --> 00:29:28,880 all this kind of things 444 00:29:30,870 --> 00:29:31,970 what happened 445 00:29:33,610 --> 00:29:37,300 out then you may have fairly lengthy interactions with people just trying to understand what 446 00:29:37,300 --> 00:29:38,400 is it that your experience 447 00:29:38,990 --> 00:29:39,520 so 448 00:29:40,210 --> 00:29:45,170 when you face a problem tell exactly describe exactly what is it that happens you 449 00:29:45,170 --> 00:29:45,920 that you found 450 00:29:46,680 --> 00:29:49,700 it was a problem that you think this is the problem i have to report 451 00:29:49,700 --> 00:29:52,610 this to the committee i have to tell them and we have to fix it 452 00:29:52,610 --> 00:29:59,530 make supper better and it's really hard to understand i i've read five hundred forty 453 00:29:59,530 --> 00:30:03,070 seven bytes so it's really hard to understand before talking about it to be a 454 00:30:03,070 --> 00:30:06,250 lot of time and i was like i cannot understand this person at all i 455 00:30:06,250 --> 00:30:08,460 mean and it was all english and of like 456 00:30:09,030 --> 00:30:13,670 that's an english so it's really hard to innocent looking for talking about the mission 457 00:30:13,670 --> 00:30:16,790 not a lot or and you don't know where this top or is or at 458 00:30:16,790 --> 00:30:18,150 certain button that is 459 00:30:18,560 --> 00:30:21,570 this there has of the label when you don't know when you wonder if you 460 00:30:21,570 --> 00:30:24,780 in the right place and you cannot find what this person is talking about so 461 00:30:24,780 --> 00:30:30,470 it's really important to be really descriptive about what is it that is going wrong 462 00:30:30,470 --> 00:30:33,260 and how you perceive is how do you see this is 463 00:30:35,490 --> 00:30:41,290 what we're expectations this is another really important bit of information because it tells it 464 00:30:41,290 --> 00:30:45,410 as what you did what where your steps true to work on the problem and 465 00:30:45,410 --> 00:30:50,890 also tells you a lot of our user a interacts with software how this user 466 00:30:50,890 --> 00:30:53,730 fangs how what is the experience this user has 467 00:30:54,340 --> 00:30:54,950 so 468 00:30:55,730 --> 00:30:59,350 a lot of the feedback i get is always think that should be why and 469 00:30:59,350 --> 00:31:02,910 we don't know if that's because the reporter just think that's a better idea or 470 00:31:02,910 --> 00:31:07,590 if it's something related to your actual expectations their users and experience 471 00:31:07,940 --> 00:31:13,930 so it's really it's really helpful to make this distinguish this distinction because it it's 472 00:31:13,930 --> 00:31:14,720 very different 473 00:31:15,180 --> 00:31:19,760 if someone thinks this should be done like this because he had this problem is 474 00:31:19,760 --> 00:31:25,210 like how serious and you things a bit hard and i guess that would work 475 00:31:25,210 --> 00:31:27,780 that would solve it and it's different when the user 476 00:31:28,700 --> 00:31:33,180 expected some it's the meat it solution it's something that it's natural or we can 477 00:31:33,180 --> 00:31:34,270 say intuitive 478 00:31:34,760 --> 00:31:38,750 for forty users so it's really important to understand what is it that you expected 479 00:31:38,750 --> 00:31:39,440 to happen 480 00:31:39,980 --> 00:31:40,870 that didn't happen 481 00:31:41,860 --> 00:31:46,270 so expect to needs usually very revealing this is where i think the best information 482 00:31:46,270 --> 00:31:48,090 comes from the expectations 483 00:31:48,580 --> 00:31:53,120 and the difference between i think actually you why and i try to do wax 484 00:31:53,120 --> 00:31:57,720 and i expected why but then Z happened and i wasn't able to accomplish X 485 00:31:58,230 --> 00:31:59,710 that definitely much more helpful 486 00:32:00,350 --> 00:32:05,670 so i guess this except this is a good example of the difference on how 487 00:32:06,140 --> 00:32:11,230 on a more complete report enables it wanted to do much more for you than 488 00:32:11,230 --> 00:32:14,960 if you might to waste i think that should be white which has i said 489 00:32:14,960 --> 00:32:16,500 was a very public 490 00:32:17,840 --> 00:32:21,550 and what are you running in this is especially more than in our compass of 491 00:32:21,550 --> 00:32:26,180 free and open source operations we are always like really things operate quite a quite 492 00:32:26,180 --> 00:32:28,950 stored in sort much or at intervals and 493 00:32:30,050 --> 00:32:33,800 always and iterating and always on the mideast also 494 00:32:34,120 --> 00:32:38,190 it's really important you know what is the margin that's been running on so you 495 00:32:38,190 --> 00:32:40,750 can actually understand what is it that people were talking about 496 00:32:41,460 --> 00:32:44,910 so a lot of time it's because of the version number that i know what 497 00:32:44,910 --> 00:32:48,610 the user is talking about because some things sometimes you report a bug because you're 498 00:32:48,610 --> 00:32:53,380 using is our version and then another version this thing doesn't exist anymore anything i 499 00:32:53,380 --> 00:32:57,570 have this problem with this thing and that place and then the very using another 500 00:32:57,570 --> 00:33:01,460 version is i don't see that thing and sometimes you just like and they are 501 00:33:01,460 --> 00:33:05,420 that's result and tell the users it's all but sometimes it's not that easy to 502 00:33:05,420 --> 00:33:09,550 understand so it's really important she to say what is the version of the for 503 00:33:12,970 --> 00:33:16,800 are talk about your experience others that a lot of the bugs that we report 504 00:33:16,800 --> 00:33:23,180 nowadays are minor issues so i'll change the way about this button and on we 505 00:33:23,180 --> 00:33:26,550 just spacing here and there are make that's consistent with of the up and those 506 00:33:26,550 --> 00:33:31,610 but please don't get me wrong there really important they really make experiences ten dollars 507 00:33:31,610 --> 00:33:36,500 on usability votes there definitely crucial for the experience but we should also talk about 508 00:33:36,500 --> 00:33:40,620 how we feel when we use offer because we use it everyday if it doesn't 509 00:33:40,620 --> 00:33:41,650 make us happy 510 00:33:42,320 --> 00:33:45,420 what is the point i mean especially at me we deal with some for every 511 00:33:45,420 --> 00:33:49,950 day it should be something pleasant it should be something that it's a joyful experience 512 00:33:50,900 --> 00:33:51,590 sell 513 00:33:52,640 --> 00:33:58,580 that user experience is definitely about if something takes a lot of time to do 514 00:33:58,580 --> 00:34:02,610 it is about if you're if it makes you like it's a lot of work 515 00:34:02,610 --> 00:34:05,490 you don't you don't feel sick say if you don't feel like confident that is 516 00:34:05,490 --> 00:34:09,120 going somewhere this is about it's not supposed to be like that you should be 517 00:34:09,120 --> 00:34:14,420 content that when you do something it will create this on a result and it 518 00:34:14,420 --> 00:34:18,080 or that if you're gonna you have like you have to send email you want 519 00:34:18,080 --> 00:34:21,680 to take twenty minutes adding an e-mail you want to be a straight for express 520 00:34:21,680 --> 00:34:25,360 because it's a really simple things of all the little bits of express their really 521 00:34:25,360 --> 00:34:27,330 important for software 522 00:34:28,660 --> 00:34:35,030 so easily about thirty like usable software so cool being concerned about usability matters is 523 00:34:35,030 --> 00:34:37,320 really important it's great but 524 00:34:38,270 --> 00:34:42,630 and other said it's also condition for a good you wax but it's not all 525 00:34:42,630 --> 00:34:48,400 so we should definitely be talking more about our experiences on possible i i'm sure 526 00:34:48,400 --> 00:34:50,250 that's kind of feedback it's 527 00:34:51,320 --> 00:34:55,870 in most part of the experience feedback is like the so called it sucks but 528 00:34:55,870 --> 00:35:00,030 reports it's like people don't talk they just at you can say it's a and 529 00:35:00,030 --> 00:35:04,520 experience problem if you can see that there really and happy using that feasible for 530 00:35:04,520 --> 00:35:08,920 body you don't know why it just say it sucks and we got a lot 531 00:35:08,920 --> 00:35:11,560 of this feedback so i guess people want to talk about this but they don't 532 00:35:11,560 --> 00:35:15,280 talk about this probably so i think this is important to keep in mind 533 00:35:16,500 --> 00:35:18,750 answer yes is that right as much as needed 534 00:35:19,590 --> 00:35:21,460 be specific describe 535 00:35:21,920 --> 00:35:26,410 describe what you're seeing what you're doing what interaction it something else 536 00:35:27,050 --> 00:35:31,400 three or more race to be done it's some specify why didn't exactly way you 537 00:35:31,400 --> 00:35:32,310 try to do it 538 00:35:33,320 --> 00:35:37,320 be verbose don't have this don't be afraid to write a lot if something is 539 00:35:37,320 --> 00:35:41,670 not pretend to design it will just ignore it it's better if we provide more 540 00:35:41,670 --> 00:35:44,680 information that we've are we letter lacking information to work on 541 00:35:45,610 --> 00:35:49,970 describe that you see describing to did and most of the most important describe how 542 00:35:49,970 --> 00:35:55,550 you felt it made me frustrated and don't be and like don't be an awful 543 00:35:55,550 --> 00:36:00,500 able this just a like i felt frustrated i didn't do it is it was 544 00:36:00,500 --> 00:36:04,470 hard for me you don't have to append anyone because to i understand that when 545 00:36:04,470 --> 00:36:07,980 you're talking about your experience it can be come quite personal and you get a 546 00:36:07,980 --> 00:36:11,510 lot of anger in your heart and you have to let go but we're trying 547 00:36:11,510 --> 00:36:13,380 to working together to make things better so 548 00:36:14,500 --> 00:36:14,900 describe 549 00:36:16,930 --> 00:36:23,700 i didn't get prints ring it's really helpful if people provide screenshot of the problem 550 00:36:23,700 --> 00:36:27,380 expense and they can point this is what i'm talking about this is the bottom 551 00:36:27,380 --> 00:36:31,680 and talking about this is the barn talking about this is the thing the it 552 00:36:32,510 --> 00:36:35,670 a it there is a lot of difficult as and verbal communication and sometimes we 553 00:36:35,670 --> 00:36:37,430 don't really get to understand it shorter 554 00:36:38,290 --> 00:36:44,110 but if we provide visual aids to reports this makes it much helpful much easier 555 00:36:44,110 --> 00:36:45,590 for the device work 556 00:36:47,010 --> 00:36:50,170 and if you guys once you walk the extra miles and i guess this is 557 00:36:50,170 --> 00:36:50,970 not very 558 00:36:51,510 --> 00:36:55,940 so related to but report itself but more to just be back to a larger 559 00:36:55,940 --> 00:36:56,480 extent 560 00:36:57,390 --> 00:36:58,320 please i raise 561 00:36:58,930 --> 00:37:04,410 it's really good if you guys you raise to design to this offer easy if 562 00:37:04,410 --> 00:37:08,090 it makes you happy if it helps you get your things don if it if 563 00:37:08,090 --> 00:37:12,860 it makes your like that or you raise so people that's like this that this 564 00:37:12,860 --> 00:37:17,610 new feature is awesome it enables you to do so much more it's really hard 565 00:37:17,610 --> 00:37:21,850 to know when we're doing things right because we only know we only hear about 566 00:37:21,850 --> 00:37:23,340 when we're doing things wrong 567 00:37:24,240 --> 00:37:28,520 and it's almost like know use it's gonna news if you don't hear anything it's 568 00:37:28,520 --> 00:37:33,110 probably working and it's actually not true because sometimes people just do not care enough 569 00:37:33,690 --> 00:37:36,520 they are i can work around as i can live with that in you want 570 00:37:36,520 --> 00:37:39,520 people to just they have with what you i mean it's are like that just 571 00:37:39,520 --> 00:37:43,440 operate it something they're getting together we want people to should be proud of it 572 00:37:43,440 --> 00:37:45,320 and to be happy with it i want them to 573 00:37:46,650 --> 00:37:52,940 level you know a great help people money right tell people wanting it and there's 574 00:37:52,940 --> 00:37:55,790 also help us know we're doing we are going in the right that 575 00:37:57,450 --> 00:37:57,950 thank you 576 00:38:16,660 --> 00:38:22,340 that won't we assume so because the only use money designer z-norm projects most of 577 00:38:22,340 --> 00:38:27,010 the from line in when it comes to boss it's on the web developers 578 00:38:27,420 --> 00:38:31,630 and the thing is if i have given a solution like that immediately say this 579 00:38:31,630 --> 00:38:35,680 is are you out of this is a code if he knows and this inbox 580 00:38:35,680 --> 00:38:38,220 close not of are because it is the design of so 581 00:38:39,930 --> 00:38:44,970 okay this thing is that the record is working it what it was supposed to 582 00:38:44,970 --> 00:38:49,570 should alleviate opened should i do well i guess that something really need to i 583 00:38:49,570 --> 00:38:52,280 mean i guess you know they have been doing a very good job and getting 584 00:38:52,280 --> 00:38:56,730 developers and decided to work together and i think as we get as a get 585 00:38:56,730 --> 00:39:00,820 better wax reports on the just have to work harder and on 586 00:39:01,730 --> 00:39:05,580 well switcher because i mean you're definitely we need a i don't know i'm tell 587 00:39:05,580 --> 00:39:09,710 so identified as i mean i i'm pretty sure alan already with all the reports 588 00:39:09,710 --> 00:39:15,820 regardless so and the ability to work together with the design and that has we 589 00:39:15,820 --> 00:39:20,880 have a spring them and we met leave them excellent i think this you not 590 00:39:20,880 --> 00:39:22,430 be problem i guess it's something we just 591 00:39:24,490 --> 00:39:29,250 it's something we need to think about as a committee a and i definitely don't 592 00:39:29,250 --> 00:39:33,040 think something's are eight i think there's a lot of like that i i'm pretty 593 00:39:33,040 --> 00:39:38,110 sure somebody years that you got your not so it's physical problem are a so 594 00:39:38,110 --> 00:39:42,030 you know i problem and sometimes on will get some usability bikes that you're like 595 00:39:42,030 --> 00:39:46,390 i don't know perhaps it is difficult and a lot of times it is so 596 00:39:46,390 --> 00:39:48,830 i don't think it's a problem that doesn't exist not is it 597 00:39:49,580 --> 00:39:51,620 it's just the problem that we already have 598 00:40:11,380 --> 00:40:12,220 this one 599 00:40:12,870 --> 00:40:19,680 so i guess like a lot of like but we tools to do are very 600 00:40:19,680 --> 00:40:24,910 right you do you do the subject line than that you get a box where 601 00:40:24,910 --> 00:40:28,760 you can write a story if you want to write or you could write poems 602 00:40:28,760 --> 00:40:34,930 and letters to of about short something which basically there are very few so we 603 00:40:34,930 --> 00:40:37,570 knew we know you some 604 00:40:39,760 --> 00:40:47,600 very small this to use your masters to you know you are or you who 605 00:40:47,600 --> 00:40:52,620 do or something about a well i think we are trying to see how people 606 00:40:52,620 --> 00:40:56,090 would report correctly they were giving those exact questions 607 00:40:56,450 --> 00:40:58,430 that i presented to you guys and 608 00:40:58,840 --> 00:41:03,700 i guess people provided a lot of and experts the only certain what do why 609 00:41:03,700 --> 00:41:07,960 do you want to do something question that people to confuse with it and that 610 00:41:07,960 --> 00:41:11,710 is that it's not always burden and it doesn't really make sense us that 611 00:41:12,150 --> 00:41:15,830 so in general people when they were guided like this is what i need to 612 00:41:15,830 --> 00:41:21,360 know i feel that people are provided much better reports that were much more helpful 613 00:41:22,100 --> 00:41:27,610 and but i said it's very much tax it's very eccentric and i guess there 614 00:41:27,610 --> 00:41:34,230 is a problem that is a financing this kind of communication that it's not very 615 00:41:34,230 --> 00:41:38,230 useful for a big report so i get there is a lot of research and 616 00:41:38,230 --> 00:41:44,260 that actually observed that on it's not a very useful very helpful a very easy 617 00:41:44,260 --> 00:41:45,660 model to just write text 618 00:41:46,040 --> 00:41:53,280 like crazy on sale need something they have to think about we know but what 619 00:41:53,280 --> 00:41:58,150 i found like one of the nicer things about your for because i filled it 620 00:41:58,150 --> 00:42:02,170 out as well and my friend and neighbour fill it out that and my friend 621 00:42:02,170 --> 00:42:08,230 and neighbour be he was saying like so i followed several bugs and i was 622 00:42:08,230 --> 00:42:12,250 i was like it was kind of hyper right because he didn't have anywhere to 623 00:42:12,250 --> 00:42:16,780 be angry because none of the questions were like what were you doing like how 624 00:42:16,780 --> 00:42:21,080 are you doing it but is but he couldn't find anywhere to round in that 625 00:42:21,080 --> 00:42:25,650 for at all so you didn't of course right which i thought it is my 626 00:42:25,650 --> 00:42:32,760 opinion there is no i think when you like what do you mean only about 627 00:42:32,760 --> 00:42:37,730 you don't them gives you a lot of space to be angry at all as 628 00:42:37,730 --> 00:42:41,670 you're talking about yourself we are talking about how i mean that every night 629 00:42:42,950 --> 00:42:48,350 i like that you did something wrong it is not and a lot and the 630 00:42:48,350 --> 00:42:52,560 outer yourself and that you like very personally 631 00:42:57,850 --> 00:43:01,050 so you gonna be rewriting or who proposed guidelines 632 00:43:03,650 --> 00:43:09,030 these i can i can migrate i have there was 633 00:43:10,800 --> 00:43:13,630 it's really hard to make this request in public 634 00:43:18,990 --> 00:43:19,170 but 635 00:43:26,820 --> 00:43:27,100 what 636 00:43:31,540 --> 00:43:36,820 so forget about you probably recommend to have more structured it's 637 00:43:37,320 --> 00:43:41,110 just feels and reporting box 638 00:43:41,590 --> 00:43:48,730 but so we just to use but new houses all cool by the this book 639 00:43:48,730 --> 00:43:54,910 report form which is probably not very configurable and will look very are we wanna 640 00:43:54,910 --> 00:43:59,460 comes to the H T M L code which doesn't it's and C S the 641 00:43:59,460 --> 00:44:02,510 last time we look the that so it's probably from ten years ago 642 00:44:03,040 --> 00:44:12,670 and can know had accustomed patch what is one big text field but you normally 643 00:44:12,670 --> 00:44:15,100 have time to description from your bug reports 644 00:44:15,630 --> 00:44:21,630 and we had something in there like steps to reproduce want to three expect that's 645 00:44:21,630 --> 00:44:24,640 results actual results ripper disability 646 00:44:25,190 --> 00:44:32,690 dispatched wasn't reapplied after the last operates looks a lot from version two to three 647 00:44:32,690 --> 00:44:37,740 and i guess these are all areas that we should consider at some point 648 00:44:38,240 --> 00:44:41,100 so i'm saying this also is a run reminder to myself