Rare-earth elements containing aperiodic quasicrystals and their related periodic approximant crystals can exhibit nontrivial physical properties at low temperatures. Here, we investigate the 1/1 and 2/1 approximant crystal phases of the Ce-Au-Al system by studying the ac susceptibility and specific heat at low temperatures and in magnetic fields up to 12 T. We find that these systems display signs of quantum criticality similar to the observations in other claimed quantum critical systems, including the related Yb-Au-Al quasicrystal. In particular, the ac-susceptibility at low temperatures shows a diverging behavior chi proportional to 1/T as the temperature decreases as well as cutoff behavior in magnetic field. Notably, the field dependence of chi closely resembles that of quantum critical systems. However, the ac susceptibility both in zero and nonzero magnetic fields can be understood from the splitting of a ground state Kramers doublet of Ce3+. The high-temperature Curie-Weiss fit yields an effective magnetic moment of approximately 2.54 mu B per Ce for both approximant systems, which is reduced to similar to 2.0 mu B at temperatures below 10 K. The low-temperature specific heat is dominated by the Schottky anomaly originating from the splitting of the Ce3+ Kramers doublet, resulting in an entropy of R ln 2 at