Scripting Enabled is a conference and hack day in London, England in September 2008.

The aim of the conference is to break down the barriers between disabled users and the social web as much as giving ethical hackers real world issues to solve. We talked about improving the accessibility of the web for a long time - let's not wait, let's make it happen.

Scripting enabled presentation on 14th of August in Stanford University

August 9th, 2008

Next Thursday, the 14th of August I’ll be guest at Stanford University to give a talk about accessibility hacking and Scripting Enabled.

Get all the details on the Stanford Online Accessibility Program Site

In other news, there might be a Scripting Enabled Seattle coming up later in the year and I will liaise more with the University outreach people here at the Yahoo mothership in Sunnyvale, California to see what else can be done stateside :)

The biggest barrier to accessibility and inclusive design is us

July 22nd, 2008

I’ve just finished reading this gem of a blog post ranting on and on that usability and accessibility are overrated and I stand mildly impressed, but I also utter a sigh of “not again”. First and foremost this is what annoys me most about it:

By the way if what you’re saying doesn’t cause any controversy then
  • you’ve just discovered some new universal truth (only happens in maths),
  • or you’re just repeating some nicely sounding but ultimately meaningless slogan like “use the best tool for the job”,
  • or most likely - nobody reads your blog.
So controversy and exaggeration to get the point across are good.

He is right, of course - blogging is war and only by misleading and cloaking your real intentions in exaggeration will you be able to reach the herds of stupid people that read your blog. Don’t bother trying to persuade people with positive and interesting examples - a good smack to the head is what the web needs - constantly. You are our only hope.*

* might contain exaggeration

Actually - and please tell me off I am wrong about this - I found that full-on-guns-blazing articles and blog posts meant to spark controversy are in most of the cases simply based on either extreme boredom or just plain lack of subject matter experience and knowledge (another reason is that it gets you a lot of feedback fast and makes you stand out - after all you are the most important person there is).
It is amazingly easy to de-rail for example constructive meetings and communication with a simple “But let me play devil’s advocate here for a second…”.

With the aim to spark controversy and exaggerate in mind, I am happy to dismiss most of the rest of the post as misguided ranting with maybe a grain of truth. Therefore let’s take a closer look at this grain for a bit.

Accessibility and inclusive design has one massive enemy: bad communication

Whoever thinks that inclusive design and accessibility is a technical problem is sadly mistaken. While it is true, that technical barriers to making things accessible are legion, the main problem is that we just don’t talk to each other the right way.

Truly inclusive and accessible products are a result of people who understand the needs of other people working with people that know how to make machines behave the way we want them to. Sadly enough these skills are in a lot of cases mutually exclusive.

A problem of communication channels

This starts with communication channels. When you work with charities who can test products with various levels of access you have to deal with a lot of red tape when it comes to communication - no work on Fridays, OOO messages, decisions have to be signed off by three people all of them available on different days of the week and during different times. When you want to reach another developer you check their online status and send them an instant message or a direct twitter message. If they are offline you send them an email and you know for a fact that an answer will be back to you at the latest in a few hours.

Developers will get frustrated when you don’t answer their emails for days, and they will get very annoyed when you call them on the phone for a simple question instead of just pinging them or sending them an email. Emails make sense - you know what you talked about and you can answer them as part of your work - picking up a phone means a disruption in your day-to-day work.

Non-technical folk however are frustrated by instant messaging and emails as these things are not part of their every day life.

In essence, we communicate with the wrong means in the wrong manner. This leads to frustrations and truisms when it comes to interaction between the two groups.

A problem with language - keeping it simple is not an option

The next issue accessibility has is that both parties just don’t communicate with another in easy to understand terms - which has quite a bit of irony to it especially when it comes to accessibility.

Tech people have quite an interesting way of communicating - the speed of online communication takes its toll and you can see that both in heavily reduced sentence length and in over-use of three letter acronyms. Many a comedy writer is taking this on right now and both The IT crowd and The Big Bang Theory are great examples to illustrate how we come across.

Accessibility people on the other hand have an own complex world of their own - especially when it comes to political correctness of what to call what group of people with which kind of - dear me, can I call it a problem, a disability or should I go for different ability? All of these terms have been changing constantly over the years and are differing from region to region. It is a veritable tower of babel and flowing off the handle when someone dares to use the wrong one is a sure-fire way to get a tech geek to just pack it in altogether.

Educating people means understanding that they do not know the same things that you do and if they do something wrong it is not because they are evil or stupid. Most of the time they are just not aware of their folly. Genuinely evil people are very scarce indeed and you can actually recognize them either by the lightning coming out of their hands or by them stroking a big white cat and sitting in underground volcano lairs.

A problem of attention span. Err, what?

Ok, this goes down two ways:

Geeks don’t want to hear about the problem, they love to remove barriers to reach a solution. The social and anthropological and - especially - the political and procedural aspects of the issue are lost on them. You can get a geek to spend sleepless nights removing a 2 pixel difference of layouts across browsers but you lost them in the second you start “let me tell you who I have to talk to about this…”. Bear that in mind, when you ask for solutions.

The other side of that is that non-technical people don’t really care much for hearing about why something is technically not possible. After all those tech guys all know their stuff, right? Installing a new video card is technically the same problem as fixing a broken web site, right? Well, they’re not and the best way to not get them to do something for you is show an immense non-interest in the technical parts of the solution.

Even if half of what your geek or non-geek counterpart tells you is mayan to you, just roll with it. Both of you are very proud of what you do - show interest and don’t ever - and I mean ever - ask for the same solution twice. If you put effort in and the other half doesn’t quite want to learn or take it in there is not much chance you’ll work together for long or even fruitfully at all.

A problem of adoption speed

This is a real issue in accessibility. Most people talking about assistive technology will tell you that Internet Explorer 6 with Windows is the only way to make Jaws behave. This is mostly because of these people having had quite a hard time to install the whole thing from the start and are not very likely to go through the process again.

Geeks on the other hand had to do that a lot more times (mostly cause people asked them to install their computers - they are technical after all) and moved on. Geeks understand that upgrading a system is the only way to keep it safe and fun to play with. I am fully aware that there is also a financial problem there, but there is just no way we can make accessibility even be a small blip on the radar of developers if we keep ourselves in the dark ages.

Check out the Universal Access features of Mac OS X and see what can be done with an operating system out of the box. Geeks love new stuff and will not look back. Even if the problem persists, make sure you know what is out there and what can be of interest rather than putting a new coat of paint on a car that should have been junked ages ago.

A problem of selling the issue

Last but not least there is the problem of selling the issue to another. Right now we do this by either scaring people into having to care about accessibility (”You will be sued!”) or by not caring about it - really - and looking for quick solutions to get it out of the way. Both are very short-term measurements and will not help anybody in the long run.

You catch more flies with honey than with vinegar (welcome to the cliché festival) and if we want to make accessibility interesting we need to make it fun, interesting, marry it with bleeding edge technology and most of all - a starting point and not an afterthought.

Alright then, off you go - talk!

Interview with WebVisum.com - crowdsourced accessibility

July 14th, 2008

A few weeks ago a lot of tweets, emails and instant messages started chatting about a new system that would allow screen reader users to fix issues with web sites in a crowdsourcing manner: http://webvisum.com.

WebVisum is a Firefox3 extension that seems to be too good to be true: it provides screen reader users with a hotkey to report bad markup and missing information and allows the community or the user himself to add the information and thus remove the barrier for the next time. I’ve caught up with Marc Dohnal, the initiator of WebVisum to ask him some questions about the system.

Hi, so can you tell me what is WebVisum, who are you and what is your engagement with it?

WebVisum is a social Firefox extension that is designed to empower the blind and visually impaired community and give them the tools they need to help themselves to a better browsing experience.
I’m responsible for the ideas and initial funding behind the project as well as the ongoing features and guidance for the development.

What are in your opinion the main problems that people with these impairments face these days and how does WebVisum help?

As someone who has had no experience with accessibility issues before I started the project, I guess I came to it with a fresh point of view. The more I read about the difficulties people are facing the more I realized that only time and lots of effort are going to improve the situation on the web today.

What I mean is that most people on the web are like me, they may not even imagine that blind people are surfing among us. And then obviously, they don’t know what tools the blind and visually impaired are using. Not to mention, that most people do not have the knowledge to make web sites and pages that comply to any and all standards - that’s something that even professionals find difficult to achieve.

So the main problems are navigational menus that are built from images only, buttons which are made out of an image and include no alt tag, and missing alt tags or important markup. There are of course more problems such as dynamic web sites (JavaScript, AJAX, Flash, etc.), but these are more advanced topics which we plan to address in the future.

And then there are CAPTCHA images which blind people are simply unable to overcome without sighted help. In the rare cases that an audio CAPTCHA is even provided, many times that CAPTCHA would be very difficult to comprehend.

Having worked as an accessibility consultant I found that people are very happy to find a checkbox to tick and then claim they are accessible. Educating people goes just so far in that. You take a different approach then?

We take a slightly different approach to this. My personal view is that it is very difficult to change the Internet (and the world) for the better. So I think we should provide the tools that allow the users in need to make the change right now, for themselves.

Once more sites and pages become standards compliant, or improve their accessibility, our tools become less relevant to these sites. But the Internet is huge and therefore it would take many years, if ever, for most of it to become accessible to a good degree.

So instead of asking and begging site operators to change their ways, to fix their pages (often trivial tasks), we build tools that allow the community to literally help itself.

How does that work in terms of workflow - especially when it comes to CAPTCHAs?

Once you’ve got the extension installed, you surf the web the way you usually do. When you encounter a page that has a CAPTCHA that must be solved in order to perform an operation such as site registration, forum or blog post, you simply hit the right hotkey, our code then finds the right image on the page and submits the image to our server. Our server will then process the image and generally in under 15 seconds the response would be provided to the user. The screen reader will read the response and the user is told that the result is in their past buffer - all they have to do is paste it into the correct form field.

We worked quite a bit to make this process as simple and as smooth as it possibly can be.

Many people think that our CAPTCHA solving is a wonderful feature, probably our number one feature. But I disagree.

Well it is the flashiest feature for sure (also slightly controversial, but let’s tackle that later). What is your favourite then?

Our most important feature is the one that allows “fixing”, “tagging” or “annotating” broken links, form fields, page titles and other page elements.
For example you go to a new site, or one that you frequent and all your screen reader reads for you is “link, link, link, image, link” and then some content that’s on the page. If it’s a site you frequent, you remember that link number 2 is the login page, for example. and link number 4 is the “contact us” page.

With our tool, you give each link its true meaning, the next time you visit that page, the screen reader will read the text that you’ve entered for every link. In addition, any other user of our service and extension would automatically get this data as well upon their visit to the same site. This means that you didn’t just help yourself by “fixing” a site you frequent, but you also helped other members of the community that may be using the same site. Everyone benefits, you help both yourself and your friends. They help themselves and you. This is what I meant when I said that our product empowers the community.

That’s a wonderful feature, but doesn’t it just mean we fix a symptom and not the cause? Are there any plans to give “fixed” sites access or maybe collaborative messages about their issues? Something like “our users fixed n problems on your site last week, can you look into that?”

There are plans to showcase these changes to site owners and have our community possibly create a presentation and maybe even a list of signatures of site users who want the change to happen. We may possibly also provide a list of sites which are popular with our users yet are very inaccessible and hopefully this way push site operators to improve their sites faster. So yes, we’re curing symptoms but quite possibly with the right tools and the community to back it up, we might be able to introduce change as well.

As we’re currenty a very small and self funded team, we’re first concentrating on what we consider as the critical issues. We’ll then branch into advocacy and related fields.

That is a great idea, as most of the time site maintainers (especially on large sites) are blissfully unaware of the issues. Another good source of information to provide to people on the web are problems that have to be constantly fixed.

Right, many site operators, just like average Internet users, are simply unaware that only little changes would make the lives of the blind and visually impaired users much easier. We can help and educate them.

This is all very obvious, but there is quite a massive amount of paranoia going on, too. Providing a means to circumvent CAPTCHA could be seen as an attempt to hack sites. One of the first proofs that CAPTCHA are a glass shield was someone hijacking a CAPTCHA and showing it on a third party site luring real users to enter the CAPTCHA (enter for free porn/downloads). This might come your way sooner or later. How can you de-fuse this scare/argument?

Yeah, there will probably be some paranoia and fear. First and foremost CAPTCHA images are not a perfect protection and that is already well known. CAPTCHAs on specific and high profile sites are routinely broken.

While our solution does solve just about any CAPTCHA that we throw at it, we restrict the use of this feature to our extension users only. Each user can solve a few CAPTCHAs per day - it is not unlimited. We employ several protections and safeguards from preventing the massive use of our API for this purpose.

We have a few tricks up our sleeves that would deter even the most dedicated hijackers from using our service for these purposes. Among other things, we plan to build a “trusted” user base, meaning, not everyone would just be able to come along, sign up and start solving CAPTCHAs. It is quite open right now, but we have plans to make this a members only club, so to speak - just not as snobbish :-)

Does members mean that people will have to pay for the service?

By members only I do not mean that we ask people to pay for these features. In fact, because we believe that these features are fundamental to the community, we do not plan to ever charge for them.

Throttling the CAPTCHA solving API and creating a trusted group is a very important step, as it would be a shame if the system would be forced to shut down because of hacking accusations. Monetization is a good question. Right now you pre-fund the service. Are you planning maybe to partner with trusted companies to possibly host the data with them?

We’ve received very positive feedback about what we’re doing right now. We’re very dedicated to maintaining this project in a trouble free manner for the entire Internet community and we will work with any site operators should any problems arise.

We’re open to partnership offers; however, we just launched two weeks ago, it’s a bit early to talk about that.

As for funding, we plan to be fund further development of features and services on top of the free core that we’ve got now. Our plan is to charge a very low monthly fee from users who wish to either support us or have access to advanced features such as PDF OCRing, and similar things.

To make it perfectly clear, we will not charge for our basic features, not now and not in the future.

There is not much information about the people behind WebVisum on the site, is that on purpose? It can spook out people a bit.

It’s not on purpose. We’ve been so busy with the extension, our server code and our site that we just didn’t have time to open up just yet. We plan to have a very open development process, too.

To our surprise, many people were saying that this is too good to be true. We’re extremely happy that they think so. We’ve been getting lots of positive feedback so far. So back to your question, we will open up very soon.

How many users and downloads have you got so far?

Sadly these numbers are way below my initial expectations. I always aim very high, though.We’ve had just around a thousand registrations and a similar amount of downloads so far. More people are signing up all the time and we see the usage increasing daily, so that’s positive.

All in all, our project is extremely young. We have had almost no beta testing before our launch and we’re delighted that any problems found so far are relatively minor and that people are happy with what they are seeing.

We’re not well known just yet, but I have no doubt that we will be.

I’ve had some feedback on the “too good to be true” part and people are a bit wary to use the system as there is a security scare about the system showing up from out of nowhere and not much being known about the people behind it. Probably some backing up by Mozilla and coverage on the Mozilla site would make that less of an issue. Is the extension available from there?

I’m actually in a way quite happy we didn’t see a huge explosion in use. In the two weeks since the launch we’ve found a good number of bugs which we’re addressing with a new release, hopefully in the next few days. After that, I would be very comfortable with more publicity.

I would say to those concerned that we would not spend thousands of dollars and countless hours of research and development just to scam, defraud of spam a relatively small Internet community such as the blind and visually impaired. With spending a similar amount of money, time and resources we could have a bunch bigger return on investment by targetting the entire Internet.

What about the software behind it? This would be a pretty cool tool for internal QA of companies, too. Visually impaired testers could report bugs without having to write up issues and explaining but the system could tell exactly which element has a problem. Are you planning to open source it or offer companies installers for money? Test servers cannot (or well should not) be accessible to the outside.

We haven’t given any thought to that kind of use just yet. We’ll address any opportunity and idea as they come along. Thanks for the idea!

I am still a bit confused about the real fixing of issues. I understand that screen reader users can report an issue with a hot key. Who provides that information that is missing then and how is that moderated? Is there a wiki of latest changes where other community members can verify fixes?

Users provide the information themselves. For example, a user can figure out a good and descriptive page title or link name, just by reading through the content of that page.

Any user can then come and modify the tags further, refine them, adjust them, etc.

We plan to export all of the tagging history for all sites through our web site, to our users. They would be able to see who edited which field, when, what they wrote, etc. Users would then be able to vote which description fits the purpose best, etc. The same would go for moderation.

So if I follow a link that is empty (because of a lacking alt attribute on the image nav for example) I can retroactively say that this link really links to that page with this information without having to go back? Is there a link cache or do I have to follow the link, read, and go back?

Exactly! In fact we have a special key sequence that says “Label last visited link”. Now that you’ve established the purpose of the page you’re at, you can simply hit that key and label the link which brought you here.

That could be mixed with social bookmarking sites. I found for example that people find better tags and descriptions for my sites in del.icio.us that I could have ever come up with.

Agreed. We’re open to mix and match various sources for the data. Again, our product and offer is very young and we have a long task list ahead of us. We hope to create a very open environment, wikipedia style.

The other good idea is to use Yahoo’s site explorer or similar systems to learn about sites linking to the current site and automatically tag those. That way you could enhance links automatically without having to visit them

We do have various ideas and ambitions about automatic tagging and fixing of links, etc. But first we must be sure that our core is stable, easy to use and bug free.

Which brings me to the last question for now. What do you need now to take this further? How can the community or companies help you?

First and foremost we will see how far we can go with the amount that we have invested so far. There are possibilities of grants and similar help. Possibly revenue that we may be able to generate from added value services would suffice, at least in the short term.

We’re fresh out of the oven, a lot will happen in the next few months that will shape our look into the future.

Well, thanks for the interview. I think it is nice that you came into the whole accessibility arena from a different angle and found something to have fun with. Any last words or greetings you want to give out?

I’d like to thank Marco Zehe from Mozilla for being the first to do an in-depth review of what we’re doing and Aaron Leventhal of IBM for his support. Both of these guys have been very supportive, provided lots of positive feedback and everyone appears to love what we did so far. We’re having fun working on this and we couldn’t be happier with the results so far.

If you’re a user, or a potential user and need help in getting this going, please don’t hesitate to contact us, we’re happy to help! We’ll be setting up a mailing list, possibly a forum and definitely a Wiki so we can better document the tool and how to use its full potential.

IBM proposes collaborative fixing of inaccessible web sites

July 9th, 2008

Over in the mad scientistresearch labs of IBM, researchers thought along the same lines as we do here: a lot of inaccessible content is not very likely to get fixed by site maintainers, but we could use the “wisdom of the masses” and “crowdsourcing” to make people who partake in the web actually heal it.

The Social Accessibility Project is an add-on to screen readers that would allow users to report missing meta data in a site and interested surfers to add this information with a browser plug-in. The information will be collated on a server and other users (and the initial reporter) can assess and comment on the quality of the fix.

The idea is pretty cool (although other projects like Webvisum go further and also allow solving of real barriers like CAPTCHAS - we will report more on them once they answered our request for an interview) but somehow there are some problems with it:

  • the original publishers never get the wiser about these issues (maybe introducing a threshold to contact them - “here are 20 things people fixed to make your site available to them, can you look into that?”)
  • there is a privacy and communication issue there. Other people that have been around as long as I was may remember the outcry about Third Voice, a company that allowed people to add sticky notes to web sites without them knowing about it (which of course ended up in more rude stickies than real help) and Microsoft learnt rather fast that there is not much smart about their Smart Tags in XP

Don’t get me wrong, I love the idea of crowdsourcing fixes (after all this is what we are doing with scripting enabled), but there is a real danger of spooking out a lot of people that are just not ready yet to face the fact (and the necessity) of freeing your data and throwing it out there for improvement and disussion.

Justgiving.com joins as another partner/sponsor

July 9th, 2008

I spent an enjoyable morning traveling through sunlit London (seriously, is this supposed to be July?) visiting the offices of justgiving.com. I got the tip to talk to them from my ex-colleague and now full-time Moo, Mecca Ibrahim at the last Mini Bar.

Justgiving.com are a lovely bunch of people that make it easy for charities to raise money by making the right people talk to each other. After I stated my Scripting Enabled case and generally chatted about the abundance of miscommunication between geeks and the IT challenged we found a lot of ways how we can help each other, me with helping them with their upcoming APIs and partnerships and them by advocating my cause to charities that should be involved and some monetary sponsorship for the event.

So thanks, justgiving.com and I hope we can do a lot together.

Results of Easy YouTube user testing with people with learning disabilities

July 7th, 2008

Accessibility User Testing goddess Antonia Hyde from United Response just posted the results of user testing the Easy YouTube player with people with learning disabilities on her blog

Her findings so far:

Things people liked
  • The control buttons. They were the right size and were easy to understand
  • Being able to change the video size
  • The volume indicator
  • The search facility
  • Being able to put the address in the address bar and see the video they wanted, even if they needed help to do it

Things people wanted to be different

  • Less information on the player (too many words)
  • Things to be organised a bit differently
  • The address facility to be at the bottom of the player, not at the top. (The screen was the main concern.)

Things people would like but are not there

  • A state change to show that you are about to select a button or a video size
  • Visual clues for the different video size options
  • Pictures for the search results (Or if not then, for it to be clearer that you can select these options)
  • A timecode to tell you how long the video is
  • Something to tell you how many videos you will get from the search facility

None of these issues are really hard to put in and I will do so soon.

Check out the post on Antonia’s blog and comment there (or here, I will forward ;) )

We have a venue!!!

July 3rd, 2008

I am right now at 2gether08 and I had the great opportunity to meet Martin Wright from London Metropolitan University. We talked, we had food, we discussed and Martin agreed to host Scripting Enabled in both the University building at Holloway road and the Gamelabs for the second day.

I will get more details earlier in the week and then give out full information of locations, set up upcoming, backnetwork and eventwax for tickets.

I am very happy about this and can go on with the next steps!

Flash can now be indexed by search engines and other code

July 1st, 2008

<farnsworth>Good news everyone!</farnsworth>: Adobe today announced the new searchability features of Flash complete with a specifications document of the SWF format.

This means that as hackers we can now access SWFs on a very low level to extract data that might not be available to end users (those who have no flash, or cannot navigate it).

Piggy-backing on this Google announced that they are indexing SWF and according to Adobe Yahoo! are soon to follow.

This is good news and bad news. For some years people have been using Google to read PDF documents (as Google indexed them and offered an HTML version and because it is terribly hard to create accessible PDFs or, as Heni put it, that PDFs suck!. Now Google can be used as a cheap way around the Flash issue, too.

Both means though that companies are more likely even less inclined to spend extra effort to make data available independent of plug-ins. The old “if it doesn’t work in a screen reader, it’ll be impossible to find by search engines” argument is out of the window now. Shame, it worked well (although we shouldn’t have to force people to consider accessibility).

The other really terrible news about this is that Flash generated by JavaScript will not be indexed at all:

“Googlebot does not execute some types of JavaScript. So if your web page loads a Flash file via JavaScript, Google may not be aware of that Flash file, in which case it will not be indexed.”

This is really bad as using SWFObject to include your Flash in web sites is the only sensible way - you test for support before you apply and you enhance progressively. There has to be a way around this problem. Just making it indexable by search engines should not stop people from assuming users have the right flash version.

First location offer turned out to be not possible

June 30th, 2008

Trying two more locations this week. London is an annoyingly expensive town.

Mailing list / Forum is now live on Yahoo Groups

June 25th, 2008
Some people asked if there is a mailing list to get updates about Scripting Enabled and to discuss all things about the idea and conference. I set up a Yahoo Group for this:
If you have problems signing up, please comment here and I will try to help you out.

Partners

Metropolitan University

To do

  • Catering
  • Video recording
  • Hack Hosting
  • Backnetwork
Scripting Enabled is a conference organized by , a developer evangelist living and working in London, England. Download vcard.

Keep up-to-date with feeds: Entries (RSS) and Comments (RSS).