Those networks are named as discrete neural networks. There are already research...

mst_moonshine on Dec 10, 2023 | parent | context | favorite | on: QuIP#: 2-bit Quantization for LLMs

Those networks are named as discrete neural networks. There are already research on those, mainly for (homomorphic) encryption purposes (because it’s much easier to homomorphically encrypt NNs of just 0’s and 1’s than normal NNs).