JobsJob TrackerJob alerts

IIT Gandhinagar ยท 10 questions

All 10Coding 8Low-Level Design 2
  • Find the height of a binary treeCoding
  • Time complexity to find maximum in min heapCoding
  • Two elements with sum equal to xCoding
  • Two numbers whose sum equals the rest of n-2 elementsCoding
  • Transformer Architecture and Positional Embeddings in NLPLow-Level Design
  • Transformer Structure, Self-Attention, and Word EmbeddingsLow-Level Design
  • Second Minimum Spanning TreeCoding
  • Reverse a String and Check PalindromeCoding
  • Find Middle and Detect Circular Linked ListCoding
  • Dijkstra's Algorithm with BFS ModificationCoding
โ† IIT Gandhinagar questions
  1. Interview questions
  2. IIT Gandhinagar
  3. Transformer Structure, Self-Attention, and Word Embeddings
Low-Level DesignReported in a candidate post, Apr 2024

Transformer Structure, Self-Attention, and Word Embeddings

Filed under IIT Gandhinagar

The question

Explain the structure of Transformers, how normalization works in them, self-attention mechanisms, and word embedding methods used in recent projects.

No write-up yet. Related questions below have one.

Related IIT Gandhinagar questions

  • Transformer Architecture and Positional Embeddings in NLP
โ† Transformer Architecture and Positional Embeddings in NLPSecond Minimum Spanning Tree โ†’

Collected from public candidate posts and coding forums. Updated Nov 2026.