We develop a graphical language for continuous variable quantum computation (CVQC), which generalizes the ZX-calculus to infinite dimensional Hilbert spaces. Along with the Z and X spiders associated with the position and momentum basis, we introduce the Fock spider for the discrete Fock basis; this allows us to additionally define the W node. We describe the diagrammatic representation of the universal set of gates for CVQC, which consists of Gaussian operations and a non-Gaussian operation. We show applications of our graphical calculus to gaussian boson sampling and fault-tolerant CVQC.