TCP State Diagram

In the world of connection-oriented networking, before any data can flow between communicating parties, a connection must first be established. This process begins with a fundamental asymmetry: one side must be waiting for connections while the other side initiates them. The TCP LISTEN state represents this waiting posture—a server's declaration that it is ready, willing, and able to accept incoming connection requests.

The LISTEN state is deceptively simple in concept but remarkably sophisticated in implementation. It represents the intersection of application-level socket programming, operating system kernel mechanics, network protocol state machines, and security engineering. Understanding LISTEN deeply means understanding how modern networked services—from web servers handling millions of concurrent connections to database systems managing connection pools—begin their existence.

This page explores the LISTEN state with the rigor and depth it deserves, examining not just what it is, but how it works at every layer of the stack, why it's designed the way it is, and what can go wrong when it's misunderstood or misconfigured.

In TCP's state machine, the LISTEN state represents a passive open—a socket that has been prepared by the server to receive incoming connection requests but has not yet engaged in any active communication. This is fundamentally different from the client's perspective, where a connection begins with an active open that immediately triggers the three-way handshake.

The Client-Server Asymmetry

The LISTEN state exists because TCP implements connection-oriented communication using a client-server model at the connection establishment level (even if the subsequent data exchange is symmetric). Consider the fundamental problem:

• Client perspective: "I know which server I want to talk to. I'll initiate contact."
• Server perspective: "I don't know who will want to talk to me or when. I must wait."

This asymmetry requires fundamentally different socket behaviors:

The Waiting Game

A socket in LISTEN state is performing a crucial but seemingly passive function: it is not transmitting or receiving data, not participating in any handshake, and not acknowledging any packets. Yet it is very much active at the system level:

1. Registered with the kernel's networking stack as eligible to receive SYN packets addressed to its bound IP:Port combination
2. Associated with connection queues that buffer incoming connection attempts
3. Consuming system resources including file descriptors, memory for queue structures, and kernel data structures
4. Subject to security scrutiny as open ports visible to network scanners

The State Machine Position

The LISTEN state occupies a unique position in TCP's finite state machine:

                              ┌─────────────┐
                              │   CLOSED    │
                              └──────┬──────┘
                                     │
                        Passive Open │ socket(), bind(), listen()
                                     ▼
                              ┌─────────────┐
                              │   LISTEN    │◀───────────────────────┐
                              └──────┬──────┘                        │
                                     │                               │
              Receive SYN            │                               │
              Send SYN+ACK           │                               │
                                     ▼                               │
                              ┌─────────────┐                        │
                              │ SYN_RECEIVED│                        │
                              └──────┬──────┘                        │
                                     │                               │
              Receive ACK            │                               │
                                     ▼                               │
                              ┌─────────────┐     Close              │
                              │ ESTABLISHED │─────────────────────────┘
                              └─────────────┘     (new socket created,
                                                   server returns to LISTEN)

Notice a critical detail: when a client connects to a listening socket, the listening socket itself does not transition to SYN_RECEIVED. Instead, a new socket is created to handle that specific connection while the original socket remains in LISTEN, ready for more connections. This is fundamental to understanding how servers handle concurrent connections.

Transitioning a socket into LISTEN state requires a specific sequence of system calls, each performing a distinct function. Understanding this sequence is essential for network programming and debugging.

The Three-Step Preparation

Step 1: socket() — Create the Socket

The journey begins with creating a socket—a kernel-managed endpoint for network communication:

int sockfd = socket(AF_INET, SOCK_STREAM, 0);

• AF_INET: Specifies IPv4 addressing (use AF_INET6 for IPv6)
• SOCK_STREAM: Indicates TCP (connection-oriented, reliable byte stream)
• 0: Let the system choose the appropriate protocol (IPPROTO_TCP)

At this point, the socket exists but has no address. It's in the CLOSED state—a blank slate.

Step 2: bind() — Assign an Address

The socket must be bound to a specific local address (IP and port):

struct sockaddr_in server_addr;
server_addr.sin_family = AF_INET;
server_addr.sin_addr.s_addr = INADDR_ANY;  // Listen on all interfaces
server_addr.sin_port = htons(8080);         // Port 8080

bind(sockfd, (struct sockaddr *)&server_addr, sizeof(server_addr));

Key considerations:

• INADDR_ANY (0.0.0.0): Accepts connections on any network interface
• Specific IP: Restricts listening to one interface (more secure)
• Port selection: Ports below 1024 require root/admin privileges on most systems
• Port reuse: The SO_REUSEADDR option allows binding to recently-used ports

Step 3: listen() — Enter LISTEN State

The critical transition occurs with the listen() call:

int backlog = 128;  // Connection queue size
listen(sockfd, backlog);

This single call performs several important operations:

1. Transitions the socket from CLOSED to LISTEN state
2. Allocates connection queues in the kernel
3. Registers the socket as eligible to receive SYN packets
4. Sets the backlog parameter controlling queue limits

The Backlog Parameter Deep Dive

The backlog parameter is one of the most misunderstood aspects of TCP programming. Its behavior has changed over time and varies by operating system:

The Two-Queue Model (Modern Linux)

Modern systems typically implement a two-queue architecture:

                         SYN Received
                              │
                              ▼
                     ┌─────────────────┐
  Incoming SYN ─────▶│   SYN Queue     │ (Incomplete connections)
                     │ (syn_backlog)   │ Waiting for ACK to complete handshake
                     └────────┬────────┘
                              │
              Handshake       │ Three-way handshake completes
              Completes       │
                              ▼
                     ┌─────────────────┐
                     │  Accept Queue   │ (Complete connections)
                     │   (backlog)     │ Waiting for application accept()
                     └────────┬────────┘
                              │
                              ▼
                     Application calls accept()

• SYN Queue: Holds connections that have received SYN and sent SYN+ACK, awaiting final ACK. Sized by kernel parameters (net.ipv4.tcp_max_syn_backlog).
• Accept Queue: Holds fully established connections waiting for the application to accept(). Sized by the backlog parameter in listen().

Understanding how the kernel implements LISTEN state reveals crucial performance and security characteristics. Let's examine the Linux implementation as a canonical example.

Data Structures

When a socket enters LISTEN state, the kernel allocates and initializes several data structures:

struct inet_connection_sock

This structure contains the listen-specific data:

struct inet_connection_sock {
    /* ... inherited socket fields ... */
    
    struct request_sock_queue icsk_accept_queue;
    /* Queue of complete connections waiting for accept() */
    
    /* Backlog limit */
    int icsk_backlog;
    
    /* ... other fields ... */
};

struct request_sock_queue

The accept queue is implemented as:

struct request_sock_queue {
    spinlock_t rskq_lock;
    
    /* SYN queue (incomplete connections) */
    struct request_sock *rskq_syn_table[SYN_HASH_SIZE];
    u32 rskq_syn_table_hash_rnd;
    
    /* Accept queue (complete connections) */
    struct request_sock *rskq_accept_head;
    struct request_sock *rskq_accept_tail;
    
    /* Statistics */
    u8 rskq_max_qlen;    /* Maximum queue length */
    atomic_t qlen;        /* Current queue length */
    atomic_t young;       /* Recently added entries */
};

SYN Arrival Processing

When a SYN packet arrives at a listening socket, the kernel performs a complex sequence of operations:

1. Demultiplexing: The kernel's network stack routes the packet based on destination IP and port to the appropriate listening socket.

2. Queue Capacity Check: Before allocating resources, the kernel checks if there's room in the SYN queue.

3. Request Socket Creation: A lightweight "request socket" (request_sock) is created to track this incomplete connection.

4. SYN+ACK Generation: The kernel generates and sends the SYN+ACK response.

5. Timer Setup: A retransmission timer is set for the SYN+ACK in case the final ACK doesn't arrive.

Queue Overflow Behavior

What happens when queues fill up?

SYN Queue Full

When the SYN queue is full and a new SYN arrives, the behavior depends on kernel configuration:

Accept Queue Full

When the accept queue is full and handshake completes:

The key insight: accept queue overflow is almost always an application problem—the server isn't calling accept() fast enough.

The LISTEN state creates a fundamental security vulnerability: state asymmetry. A client can consume server resources (queue entries) with minimal cost (sending a single SYN packet). This asymmetry is the foundation of SYN flood attacks.

The SYN Flood Attack

A SYN flood exploits the mechanics of the three-way handshake:

1. Attacker sends massive volumes of SYN packets with spoofed source addresses
2. Server responds to each with SYN+ACK and creates queue entries
3. Final ACKs never arrive because the spoofed addresses don't correspond to real clients
4. SYN queue fills up and legitimate connections are dropped
5. Server resources exhausted tracking half-open connections

                    Attacker
                       │
        ┌──────────────┼──────────────┐
        │              │              │
        ▼              ▼              ▼
    SYN (src=A)    SYN (src=B)    SYN (src=C)
        │              │              │
        └──────────────┼──────────────┘
                       │
                       ▼
                ┌─────────────┐
                │   Server    │
                │  (LISTEN)   │
                └──────┬──────┘
                       │
        ┌──────────────┼──────────────┐
        │              │              │
        ▼              ▼              ▼
  SYN+ACK to A   SYN+ACK to B   SYN+ACK to C
        │              │              │
        ▼              ▼              ▼
   (A doesn't    (B doesn't    (C doesn't
    exist or      exist or      exist or
    ignores)      ignores)      ignores)

SYN Cookies: A Stateless Defense

SYN cookies eliminate the need to store state for half-open connections:

How They Work:

1. When a SYN arrives, instead of creating a queue entry, the server encodes connection parameters into the Initial Sequence Number (ISN) of the SYN+ACK.

2. The encoded ISN contains:

   • Timestamp (5 bits, truncated)
   • Maximum Segment Size (MSS) index (3 bits)
   • Cryptographic hash of client IP, port, server IP, port, and timestamp

3. When the ACK arrives, the server reconstructs the connection parameters from the acknowledgment number (which is the SYN cookie + 1).

4. If validation succeeds, the connection is established without ever using the SYN queue.

SYN Cookie Trade-offs

SYN cookies are not a perfect solution. Understanding their limitations is crucial for proper deployment:

Advantages:

• No state required for half-open connections
• Resistant to SYN floods (attacker can't exhaust server memory)
• Transparent to legitimate clients
• Automatically enabled only when needed (when queues fill)

Disadvantages:

• Limited MSS options (only 8 values encoded)
• TCP options from the client's SYN are lost (no SACK, window scaling, timestamps in cookie mode)
• Slight CPU overhead for cryptographic computation
• Five-bit timestamp limits detection of delayed ACKs

Understanding LISTEN state is essential for diagnosing connection problems in production systems. Here are the key tools and techniques.

Inspecting Listening Sockets

Using netstat (traditional):

# Show listening TCP sockets
netstat -tlnp

# Output:
# Proto Recv-Q Send-Q Local Address     Foreign Address   State    PID/Program
# tcp   0      0      0.0.0.0:80        0.0.0.0:*         LISTEN   1234/nginx
# tcp   0      0      127.0.0.1:5432    0.0.0.0:*         LISTEN   5678/postgres

Using ss (modern, preferred):

# Show listening TCP sockets with extended info
ss -tlnp

# Show queue depths
ss -tlnp -o

# Output includes Recv-Q (accept queue length) and Send-Q (backlog setting)

Queue Monitoring

Monitoring queue depths reveals capacity problems before they cause connection failures:

# Check accept queue status for specific port
ss -ln sport = :80

# Fields:
# Recv-Q: Current number of connections in accept queue
# Send-Q: Maximum queue size (backlog)

# If Recv-Q approaches Send-Q, connection drops are imminent

System Counters

Linux tracks various LISTEN-related events that help diagnose problems:

# View SYN queue overflows
netstat -s | grep -i syn

# Key metrics:
# - SYNs to LISTEN sockets dropped (SYN queue full)
# - times the listen queue of a socket overflowed (accept queue full)

# Watch in real-time
watch -n1 'netstat -s | grep -i "listen\|syn"'

Key Kernel Metrics:

Common Problems and Solutions

Problem: "Connection refused" errors

• Cause: No socket in LISTEN state on target port
• Diagnosis: ss -tlnp | grep PORT returns nothing
• Solution: Ensure server process is running and listening

Problem: "Connection timed out" errors

• Cause: SYN+ACK not received (firewall, routing issue, or overloaded queue)
• Diagnosis: Check for ListenDrops; verify firewall rules
• Solution: Increase queue sizes; add capacity; check network path

Problem: Slow connection establishment

• Cause: accept() not called fast enough; connections queuing
• Diagnosis: Recv-Q consistently high in ss -ln
• Solution: Improve application accept loop; use non-blocking I/O

The LISTEN state's behavior influences how servers are architected. Different patterns handle the accept loop and connection processing differently, each with distinct performance characteristics.

Single-Threaded Accept Loop

The simplest pattern: one thread accepts connections and hands them off:

while (running) {
    int client_fd = accept(listen_fd, NULL, NULL);  // Blocks here
    spawn_worker_thread(client_fd);  // Hand off to worker
}

Characteristics:

• Simple to implement
• Accept becomes bottleneck under high connection rates
• Suitable for moderate connection rates (< 10,000/sec)

Multi-Socket Load Distribution (SO_REUSEPORT)

Linux 3.9+ allows multiple sockets to bind to the same port:

int opt = 1;
setsockopt(sockfd, SOL_SOCKET, SO_REUSEPORT, &opt, sizeof(opt));

The kernel distributes incoming connections across sockets, enabling multiple accept loops:

                         Incoming Connections
                                 │
                                 ▼
                    ┌────────────────────────┐
                    │   Kernel Load Balancer │
                    │     (SO_REUSEPORT)     │
                    └────────────────────────┘
                                 │
              ┌──────────────────┼──────────────────┐
              │                  │                  │
              ▼                  ▼                  ▼
        ┌─────────┐        ┌─────────┐        ┌─────────┐
        │ Socket 1│        │ Socket 2│        │ Socket 3│
        │ (CPU 0) │        │ (CPU 1) │        │ (CPU 2) │
        └─────────┘        └─────────┘        └─────────┘
              │                  │                  │
     Accept Loop 1      Accept Loop 2      Accept Loop 3

Characteristics:

• Near-linear scaling with CPU cores
• Each socket has independent queues
• Better cache locality per-core
• Used by high-performance servers like NGINX and HAProxy

Non-Blocking Accept with Event Loops

High-performance servers (Node.js, NGINX, HAProxy) use non-blocking sockets with event notification:

// Set socket non-blocking
fcntl(listen_fd, F_SETFL, O_NONBLOCK);

// Add to epoll
epoll_ctl(epfd, EPOLL_CTL_ADD, listen_fd, &ev);

// Event loop
while (running) {
    int n = epoll_wait(epfd, events, MAX_EVENTS, -1);
    for (int i = 0; i < n; i++) {
        if (events[i].data.fd == listen_fd) {
            // Accept all pending connections (non-blocking)
            while ((client_fd = accept4(listen_fd, NULL, NULL, SOCK_NONBLOCK)) >= 0) {
                // Register new client with epoll
                epoll_ctl(epfd, EPOLL_CTL_ADD, client_fd, &client_ev);
            }
        }
        // ... handle other events ...
    }
}

This pattern:

• Never blocks on accept (uses edge-triggered epoll)
• Drains entire accept queue per notification
• Maximizes throughput while minimizing latency

We have explored the TCP LISTEN state comprehensively—from its conceptual role in client-server communication to its kernel-level implementation, security implications, and operational considerations.

Key Takeaways

What's Next

The LISTEN state is just the beginning of a TCP connection's lifecycle. When a client sends a SYN to a listening socket, the server side transitions from LISTEN to SYN_RECEIVED—we call this a "passive open with SYN received." Meanwhile, the client enters the SYN_SENT state after its "active open." In the next page, we'll explore these two states in detail, understanding how the three-way handshake progresses and what can go wrong during this critical phase.