Reported in a candidate post, May 2025
ReLU, its drawback and positional encoding in transformers
Filed under Meesho
The question
Explain the ReLU activation and its drawback, positional encoding in transformers, and why sine and cosine are used instead of binary values.
No write-up yet. Related questions below have one.
Related Meesho questions
Collected from public candidate posts and coding forums. Updated Nov 2026.