Archive for the ‘Failed applications’ Category

Local Roads = No Checkpoints, Mostly

Wednesday, June 4th, 2008 by The Director

Target’s Find a Store feature offers limited usability for its Get Directions feature, since it obviously lacks insight into inconsequential details like street names:

Local Roads?  Where we're going we don't need Local Roads
Click for full size

That’s a mapping utility of dubious usability. Now, if you wanted to go Southern, I guess they could insert landmarks properly:

  1. Y’all go down to the old Phillips station that’s now a used tire shop and turn RIGHT (West).
  2. Go over the crick and on the little dirt road by the magnolia tree where Bud Walters crashed his bike and turn RIGHT (North).
  3. When you get to the pole where Jeb’s scarecrow used to be, turn RIGHT (North)….

Nah.

Instead, we’ll launch this application with a couple of known issues.

Security Is Job 1; Unfortunately, We’re Counting Down From 65,000

Monday, June 2nd, 2008 by The Director

Son of a glitch:

Paying bills online is fast, efficient, and you save the price of a postage stamp.

But how safe are you? Every company with an online payment system says you needn’t worry about privacy or security.

Leigh McDowell believed it.

She’s a paralegal in O’Fallon, Ill., and pays her $60 monthly cable TV bill to Charter Communications online on her home computer. She has paid electronically without any problem for five years.

Tuesday morning, she entered her regular logon and password, but got the Charter account of a woman in Kingsport, Tenn., instead.

It showed the woman’s full name, address, phone number, security code number, her cable TV service (the “Big Value Package,” with Digital Sports View), her high-speed Internet service, and her Charter telephone service (she paid $1.79 for one directory assistance call) — and her bill for $237.16.

“No stamps, no check, no hassle!” Charter promises on the woman’s electronic bill.

McDowell was horrified that she had somehow gotten into a stranger’s account. She quickly logged off. Besides, she still had her own bill to pay.

She tried again to log on to her account. This time she arrived at the Charter account of a woman in Slidell, La.

McDowell logged off and tried again, this time arriving at the Charter account of a woman in Covington, Ga.

McDowell says she did this 20 times, each time getting the account of a different Charter customer. She couldn’t see any connection between the names or addresses, although she did note that many of the accounts listed overdue bills.

“I just kept entering my name and password, and every time it gets another account,” McDowell said. “I could see everything, just as if I was that person.”

McDowell is so upset, she says, she won’t pay online again.

Here’s a quick question for you: Do you, as a QA person or other IT person, use online bill paying? I sure do not; I have worked with too many billing systems and have seen what kind of issue passes as an acceptable risk for a deployment to production. Your chances of winning the lottery don’t seem to be that far lesser than encountering a billing error. Some of which come with special “prizes” of their own in the form of extraneous, incorrect debits that can cause your bank’s overdraft charges to kick in, thank you very much.

I’ll stick with the chance of human error or data entry problems that come with writing a check, thanks. I can forgive human error, not computer error that’s engineered into a software system.

(Yes, I know that’s human error, but in too many cases, it’s human error that’s overlooked and unrepaired for a variety of rationalizations, at which point it goes beyond error into willful malfeasance.)

Make Your Application Look Broken For Extra Ad Revenue

Tuesday, May 20th, 2008 by The Director

Here’s a slideshow on Wired featuring old stewardess photos. Want to see the uh oh?

(more…)

E*Trade IRA Volunteer Form

Friday, May 16th, 2008 by The Director

Memo from reader Isarian:

Found a bug you might want to feature on QAHY - it affects E*Trade Financial’s IRA sign-up process. To reproduce:

1) Navigate to https://us.etrade.com/e/t/home/transacct
2) Click on “Apply Online”
3) Enter test user information, enter CAPTCHA string, select “Individual Account”, set Account type to “Individual Retirement Account”, click on “Continue”
4) Enter test user information, click on “Continue”
5) Select “Cash Account”, click on “Continue”
6) “How did you hear about us” field shows test fields left behind, see screenshot

I’ll be sending the same on to E*Trade - I’m guessing that it affects all of their referral menus since it’s likely they all populate using the same fields.

Note that QAHY does not actually endorse following those steps, as using junk data on production servers violates federal law if prosecutors are done working on their campaigns for attorney general or governor or reading Perry Mason novels for practical insight.

Isarian sends along this screenshot:

E*Trade bug
Click for full size

This drop-down list is probably managed administratively through an interface accessible to E*Trade staff, including testing. Remember what I said about trusting administrators? Yeah, that applies, although these test entries probably conform to applicable data entry.

I doubt that testers were conducting this sort of testing (checking to see that dynamic entries appeared in this list)–or at least, I really hope not. Instead, this might have happened when deploying code from a staging environment and just copying up the database.

It’s never a bad idea to buzz through dynamically driven items like this to make sure that test data doesn’t crop up as part of your deployment testing. If you’ve got time, the wherewithal, and access, it wouldn’t hurt to review the admin data through the admin interface to ensure that the administrators’ fat fingers hit the right keys before they clicked Save.

And as for Isarian’s comment I’m guessing that it affects all of their referral menus since it’s likely they all populate using the same fields, well, Isarian is young and has not seen the Web application administrative interfaces that I have, where the individual dynamic tables and the interfaces for entering them are added exactly as they’re needed, meaning that a drop-down list like this might have its own administrative screen somewhere whose data only shows up in this one place. Sad, but true. Check every thing, every time, you know.

(For more drop-down list fun, see “The Definition of QA Insanity“. Also related: “Keeping Your Test Data Clean“, although nobody was apparently caught being too clever.)

 

Pick On Yahoo! Day

Friday, April 4th, 2008 by The Director

Well, it wasn’t supposed to be a pick on Yahoo! day, but I’ve realized that I have a trilogy of separate bugs based on Yahoo! Web sites or applications, so I’ve decided to roll them up into a single post.

(more…)

I Can Explain It

Friday, March 14th, 2008 by The Director

Cassini probe failed to ‘taste’ moon’s geysers in flyby:

As Cassini flew over the small moon on 12 March, passing only 200 kilometres from the base of the plume, an “unexplained software hiccup” prevented the spacecraft’s Cosmic Dust Analyzer (CDA) from transmitting data to the onboard computer.

New software, designed to improve the ability of CDA to count particle hits, may be to blame. “We don’t know why it did not work,” says the instrument’s principal investigator, Ralf Srama of the Max Planck Institute of Nuclear Physics in Heidelberg, Germany. “We prepared very carefully.”

Think of the budget saved with insufficient testing. Someone probably could have gotten a performance bonus at year’s end. Now, probably not.

Could Mean Pink Slips Tomorrow

Thursday, March 6th, 2008 by The Director

On Yahoo! Finance, the full time number of employees for Micrel, Inc. shows NaN, or Not a Number:

Full time employees is null
Click for full size

It could mean a problem with the Yahoo! Finance integration with its data provider, but I would start sending resumes out just in case.

Stating the Obvious

Tuesday, March 4th, 2008 by The Director

Frequent reader gimlet sends along this helpful bit of information appearing on his XBox 360 Live screen:

Yes, it is in fact string text
Click for full size

Yes, yes, it is, in fact, string text. However, it’s that it is the default string text that is so galling.

Remember, gentle reader, to test your applications to make sure that it does not accept the placeholder text as user-entered text.

Trusting Me Was Your First Mistake

Wednesday, February 27th, 2008 by The Director

As a morale booster, I went to XE.com to use the Personal Currency Assistant to convert my meager QA salary into foreign currencies so the number is bigger. Unfortunately, the Personal Currency Assistant trusts me too much.

(more…)

Someone Failed At Boundary Testing

Monday, January 21st, 2008 by The Director

In the World of Warcraft, apparently you can have too much of a good thing:

Today, while skimming over various WoW sites, I noticed two forum posts about the same topic: Players have discovered that there’s a cap on how much money you can carry in the game. Apparently that amount is 214,748 gold, 36 silver, 48 copper. After you reach that lofty sum, you’ll no longer be able to receive money from any source in the game. While some responses to the original posts claim that this exact limit had previously been theorized to exist, there have been no reports of anyone in the game actually achieving this amount via legal means.

I feel for game testers. They really must account for all possible combinations and conditions, because some players have nothing better to do than to try to find all the possible flaws in the system. Like doing really well monetarily.

(Link seen on Slashdot.)

Don’t Ask, Or You Might Get An Answer

Thursday, December 6th, 2007 by The Director

Over at TechDirt, this story prompts a question:

It’s one thing to bounce a check and it’s another to be so far in the red Bill Gates, Warren Buffet and Donald Trump combined couldn’t come close to bailing you out. A Cobb County man got a letter from his bank with that very shocking news.

“And I open up the letter and I look at it and I’m like, ‘No, you’ve got to be kidding me,’ said Joe Martins.Martins said he recently closed an account at Wachovia Bank and made good on an outstanding check. He just got a letter about the closure and his negative balance — $211,010,028,257,303.00. That’s $211 trillion.

TechDirt asks:

Furthermore, if an error this size gets through all of the checks and balances, then what other, less noticeable errors are falling through the cracks every day?

Let’s just put it this way: Your humble director doesn’t use online bill pay, okay?

“Yahoo!” Is What I Said When I Crashed It

Monday, November 26th, 2007 by The Director
  1. I have multiple machines here in the QAHY lab.
  2. I have the Yahoo! Messenger program installed on multiple machines and it’s set to automatically log in on a couple.
  3. Yahoo! allows a single user to log in only on one machine at a time.
  4. I use custom status messages to share my wit, so I often open the dialog box that allows you to enter that text.
  5. On patch or installation days, it’s not uncommon for my PCs to contend and collide for which one is actually logged into Yahoo! Messenger.

I say this so you’ll understand that I wasn’t looking for trouble with Yahoo! Instant Messenger. I was just using the software like I normally do.

(more…)

It Just So Happens That Your Friend Here Is Only MOSTLY Dead

Sunday, November 25th, 2007 by The Director

A Civilization IV: Beyond The Sword warrior gets lucky:

Only MOSTLY dead
Click here for full size

When my health reaches 0.0, I hope I look that vertical.

That being said, I am very glad I don’t test games; there are too many variables for me to account for in games. Still, on the whole, they seem to work, don’t they?

Someone Let The Links Get Stale

Wednesday, November 21st, 2007 by The Director

If you try to launch the game Sid Meier’s Civilization IV: Beyond the Sword without the disc in the optical drive, the application pops open the dialog box that says, essentially, “Stop, ye Pirate, and show me your papers that prove this game is yours!” The dialog box has a message (lacking in a serial comma and a period, I add insult to insultery) and a link:

A helpful dialog box that turns out to be not so successful.
Click here for full size

It’s a pretty standard link sort of thing, but since it’s here on QAHatesYou.com, you can guess the result of clicking the link.

(more…)

Somethings Are Not Better Left Unsaid

Tuesday, November 20th, 2007 by The Director

Put the CD in and let it automatically run, and you get:

Exclamation point!

That sounds important.

(more…)

Said It Before, Say It Again

Wednesday, November 14th, 2007 by The Director

David S. Linthicum explains in the SD Times why SOA projects in particular fail:

It’s just one of those things. Technical projects fail, and SOA is no exception. So, how do these failures occur? Like they always do: as a result of poor planning, lack of understanding or the inability to execute—and that’s the short list.

As you and I know, this is a bright and shiny way of looking at it. The real reasons that projects fail are as follows:

(more…)

Et Tu, Bug Tracker?

Wednesday, October 10th, 2007 by The Director

Following the heels of yesterday’s crash, today BugTracker.NET crapped out on me:


BugTracker .NET takes a dirt nap
Click for full size
Why, it’s almost as though the word is getting out amongst the very tools of the QA trade about me.

Dr. Watson Commits Seppuku

Tuesday, October 9th, 2007 by The Director

How do you know if you’re a good software tester?

Dr. Watson Commits Seppuku

Dr. Watson ends it all rather than continue working with you.

 Good work!

Thanks For The Reminder

Thursday, August 30th, 2007 by The Director

I love FTP Voyager by RhinoSoft; I’ve used it off and on for a decade now. However, during one previous workstation migration, I didn’t get a license for it and relied on the command line until such time as I was managing too many Web sites relative to my typing speed. So I downloaded the trial version and ran it for 29 days (of 30) before purchasing.

Immediately, the application popped up a modal dialog box whenever I opened the application reminding me that it was a trial version and I could purchase the application and register it. After a set number of day, it began popping up the dialog box while I was running the application (in addition to when opening the application). I think this was an event-driven reminder, as it often showed when I finished a file transfer.

However, I think the reminder event logic could use a review, as it popped up the modal dialog box immediately after I successfully entered the registration code:

Remember to do what you've already done
Click for full size
Classic.

Think Of It As More Joss Stone To Love

Wednesday, August 29th, 2007 by The Director

Some songs do seem to go on forever, but not that long:


The extended remix version
Click for full size

I have no idea how iTunes deduced that. Bad data in the Internet servers keeping track of the songs? Corruption in data transmission? All I know is that the song never seems to end.