Volts and amps are not independent values if you're applying them to the same resistance (you), and you cannot "boost voltage" using capacitors. A capacitor can only charge to the voltage that it is charged with.
Yes, a single capacitor will only hold the voltage applied to it. But after charging each one and cleverly arranging them in series you can hold very high voltages with a bank of them. This is what occurs in a voltage multiplier circuit.