Authentication techniques can be used to overcome the hologram counterfeiting problems. Here, we demonstrate an authentication scheme for digital holograms in a raw-complex form that is stored either in the cloud or on the metasurface using a CNN.