There are a number of scenarios that I can see happening, most of which depend on the aerodynamics specific to the aircraft.
Scenario 1: Nose Down Force > Up Force
I believe this to be exactly what happened in this instance. What happens is that the downward deflected elevator overpowers the upward deflected elevator creating more down force than up force. This means that the pilot can't rotate the aircraft into a climb attitude. This seems the most probable otherwise the pilots would have lifted off after V1 and went around.
Scenario 2: Nose Down Force < Up Force
If the pilots were able to get the aircraft into the air, and the asymmetric elevator didn't act like ailerons, they would probably have noticed that the aircraft would easily pitch down but be very difficult to pitch up. They would have noticed that as they got faster, pulling back on the stick would have resulted in less of a pitch up. Depending on the pilots, if they noticed this quick enough they could reduce power and control it for a landing. If they didn't realize what was going on and remained at TOGA power, they may have pitched into a stall.
Scenario 3: Extra Ailerons
If the elevators had enough of a roll effect, it would cause the aircraft to roll. They could have probably countered this with opposite aileron, but depending on the amount of up force versus down force scenario 2 would have taken over, only now they would have difficulty turning. (As per Kevin) The asymmetric deployment with the elevator at the top of the tail may create a yaw component, so the aircraft may also be slipping. This can put a lot of force on the tail, especially a twisting force as the pilots put in rudder to counter the yaw.
What it really all boils down to is that the pilots were probably right in rejecting the take-off, and probably would not have noticed the problem until Vr, which is after V1. Learning how to fly a crippled aircraft is not something you want to do at low altitude. If they did get it up and managed to get it in the air, they probably would have gained as much altitude as possible and spent time learning how to fly it while burning off extra fuel. This is pretty much what happened with United 232, where they had to learn how to fly the aircraft again.
Were the pilots right? Probably, but I believe they really didn't have a choice. I'm not sure that the aircraft would have rotated at all. Once they hit Vr and realized they couldn't get the nose off the pavement, it takes a couple seconds to make the decision to pull the power and hit the brakes. At 200mph you are traveling 293 feet per second. If they took 3 seconds to realize the problem and power down, that is almost 900 feet of runway gone.