[calebsurfs]

You can take the technology part of the test here:

http://www.oecd.org/skills/ESonline-assessment/

I have to admit I found it somewhat difficult, it's not surprising that most people performed poorly on it.

[tominous]

"You must use Firefox 10 or higher."

Unexpected impasse. Multiple steps. Requires navigation across multiple pages and applications.

Just taking the test is a Level 3 task.

[vurpo]

The link took me to a 404 page.

One of the hardest computer tests I've ever taken.

[Illniyar]

I took the test (demo test at least).

Only 2 out of 6 questions had anything to do with UI/UX - the rest were either reading comprehension and/or basic math.

From the 2 that dealt with UI/UX, both were extremely hard, in one of them I had to send an email, get a token and navigate the site to send another email.

If this is what the results are based on, I wouldn't base any UI/UX decisions for web products on the results of this test.

[mrob]

The simulated environment also makes it more difficult. I accidentally tried to go back in the real browser instead of the simulated browser and broke the test. The simulated environment is also very slow.

[hbk1966]

And I requested the code 2 or 3 times until I realized there was a email tab at the bottom.

[digi_owl]

yeah, one of them told me to highlight a passage of text in some dense report about education effects. WTF does that have to do with "computer literacy"?!

[colmvp]

Yeah isn't that just reading comprehension?

[amorphid]

The user interface for that test is horrendous. I felt dumber just looking at it. The flow is quite rigid.

For example... at the start of the test, there's a "Please press 'ENTER' to continue"...

A) My keyboard has a return key, but no enter key.

B) It's a button. Has the test started yet, because I'm not sure if you're talking about the button, or the non-existent key on my keyboard.

C) You're making me think, and the test may or may not have started yet.

Maybe my reading comprehension skills are lower than I'd like to admit. Or maybe your UI makes smart people stupid.

[exolymph]

> To begin, enter the Authorization Code provided by your administrator into the box on the left and click "Submit."

Am I missing something?

/am probably more computer illiterate than I realized

[k1t]

You need to choose the "Demo Test" link.

[lucio]

Meta-UI problems

[ff10]

"Page not found." Or is that a trick question?

[claar]

Looks like they took it down -- archive.org found it again at http://esonlineenu.startpractice.com/

It's very concerning to me that they didn't include screenshots of this simulation site in their report. The pages and pages of data are meaningless without knowing what they were actually measuring.

[ARCarr]

I'm so computer illiterate I can't even click a link and get to the right page.

[jstanley]

One of the questions for the test in English is “when did you first come to the United States”, but I have never been to the United States...

Incidentally, while I got every question right, I could easily imagine myself getting one or two of them wrong. Not out of stupidity, just bad luck. The question asking about the impact of educational attainment had at least 2 sentences that plausibly answered it, yet the correct answer was to highlight just 1 of those sentences.

[Glyptodon]

"Press 'Control' + 'Alt' + 'Backspace' to log out of the browser for Linux."

I did the demo test tasks. I think their test UI is pretty bad. But I feel like anybody who's used email could probably figure most of it out.