In this article, a novel wavelet probabilistic neural network (WPNN), which is a generative-learning wavelet neural network that relies on the wavelet-based estimation of class probability densities, is proposed. In this new neural network approach, the number of basis functions employed is independent of the number of data inputs, and in that sense, it overcomes the well-known drawback of traditional probabilistic neural networks (PNNs). Since the parameters of the proposed network are updated at a low and constant computational cost, it is particularly aimed at data stream classification and anomaly detection in off-line settings and online environments where the length of data is assumed to be unconstrained. Both synthetic and real-world datasets are used to assess the proposed WPNN. Significant performance enhancements are attained compared to state-of-the-art algorithms.