The article is an attempt to evaluate an interesting proposal by Michal Heller to define the beginning of the universe (the original particularity). The proposal was presented in the book 'Poczatek jest wszedzie. Nowa hipoteza pochodzenia Wszechswiata' (The Beginning is everywhere; A New hypothesis of the origins of the universe) where it is supported with some tenets in philosophy of mathematics. The author finds these tenets questionable. He disagrees with Heller's conception of the universe, offers critical remarks about the non-temporal or extratemporal phase of the universe and raises certain doubts about possible interpretations of the origins of the universe (focusing mainly on the concept of the original peculiarity). These fairly specific observations culminate in a broader discussion of the role of mathematics in interpretation of ontological problems.