Is the webwall stateful?

Yes, it is a stateful inspection packet filter.  It maintains an active table of UDP and TCP sessions.  This way, it checks and remembers the outgoing request and only allows responses from those request back.