You could also try to find thinner dielectric, although if it is too thin, your homemade cap might not survive the high voltage. If you want lots of capacitance (but perhaps not as much voltage ...

[The LED Artist] often found a need for a relatively high voltage (100 to 200 Volt) but low current DC power supply, and it turns out that a small HV generator that uses a single AA cell only ...