Problem: Asynchronous Result Handling - Future and Promise Pattern | OneNoughtOne

0/290

System Design (LLD)Concurrency Patterns

Future and Promise Pattern

LevelIntermediate

Duration60 mins

TopicConcurrency Patterns

1 / 4

Problem: Asynchronous Result Handling

The Asynchronous Dilemma

Modern software systems rarely operate in isolation. They fetch data from remote services, query databases, read files, invoke external APIs, and perform computationally intensive operations—all activities that take unpredictable amounts of time. The fundamental question that haunts every concurrent system designer is deceptively simple:

How do you request an operation that will complete 'eventually' and obtain its result when you actually need it?

This question, seemingly trivial, reveals one of the most challenging problems in concurrent programming. The naive approaches—blocking and polling—each carry severe penalties that can cripple system responsiveness, waste computational resources, and create architectural rigidity that becomes increasingly painful as systems scale.

What You Will Learn

By the end of this page, you will deeply understand why traditional approaches to asynchronous result handling fail at scale. You'll see how blocking wastes threads, how polling wastes CPU cycles, and how callback-based solutions create unmaintainable code. This understanding is essential before we introduce the Future/Promise pattern as the elegant solution.

The Nature of Asynchronous Operations

To understand the asynchronous result problem, we must first understand what makes operations asynchronous and why modern systems are fundamentally asynchronous in nature.

Synchronous operations execute in a predictable, linear fashion. When you call a function, execution pauses at that point until the function returns. The caller and the operation share the same timeline—one completes before the other continues.

Asynchronous operations, in contrast, decouple the initiation of an operation from its completion. When you start an asynchronous operation, execution continues immediately—the operation runs 'in the background' and completes at some future point. This decoupling is both the source of asynchronous programming's power and its complexity.

Common Asynchronous Operations in Modern Systems
Category	Examples	Typical Duration	Why Asynchronous?
Network I/O	HTTP requests, RPC calls, database queries	1ms - 30s+	Network latency is unpredictable; blocking wastes thread resources
File I/O	Reading/writing large files, log operations	1ms - 10s	Disk access involves physical movement; blocking prevents other work
Computation	Image processing, cryptography, ML inference	10ms - minutes	Long computation blocks UI thread responsiveness
External Services	Payment gateways, email services, third-party APIs	100ms - 60s	External systems have their own timelines and failure modes
User Input	Form submissions, file uploads, authentication	seconds - minutes	Humans operate on vastly different timescales than computers
Timers/Scheduling	Delayed execution, periodic tasks, timeouts	configurable	Future events cannot be awaited synchronously

The Scale Amplification Problem:

In a simple application making one network call, synchronous blocking might seem acceptable—you wait 200ms, get your result, and continue. But modern systems don't make one call; they make thousands simultaneously.

Consider a web server handling 1,000 concurrent requests, each requiring a database query:

With synchronous blocking: You need 1,000 threads, each blocked waiting for database responses
Each blocked thread consumes ~1MB of stack space: 1GB of RAM just for waiting
Context switching between 1,000 threads imposes massive CPU overhead
At 10,000 requests, the system collapses under its own weight

This is why asynchronous programming isn't optional at scale—it's existential. The challenge isn't whether to handle operations asynchronously, but how to handle the results of those operations elegantly.

The Fundamental Tension

There's a fundamental tension between two requirements: (1) We must not block threads waiting for slow operations, but (2) We need the results of those operations to continue processing. Every async programming model attempts to resolve this tension. The question is: how elegantly?

The Blocking Approach and Its Failures

The most intuitive approach to handling asynchronous results is simply to wait. Start the operation, then block the current thread until the result is available. This approach is natural because it mirrors how we think about sequential operations—do this, then do that.

Let's examine what blocking actually means at the system level and why it becomes catastrophic at scale.

blocking-example
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
// Naive blocking approach - appears simple, fails at scale
public class OrderService {
    private final PaymentGateway paymentGateway;
    private final InventoryService inventoryService;
    private final ShippingService shippingService;
    private final NotificationService notificationService;
    
    public OrderResult processOrder(Order order) {
        // Thread blocks here waiting for payment (~500ms - 30s)
        PaymentResult payment = paymentGateway.processPayment(
            order.getPaymentInfo()
        );
        if (!payment.isSuccessful()) {
            return OrderResult.failed("Payment failed");
        }
        
        // Thread blocks again for inventory (~50ms - 5s)
        InventoryResult inventory = inventoryService.reserveItems(
            order.getItems()
        );
        if (!inventory.isAvailable()) {
            paymentGateway.refund(payment.getTransactionId());
            return OrderResult.failed("Items unavailable");
        }
        
        // Thread blocks for shipping calculation (~100ms - 2s)
        ShippingResult shipping = shippingService.scheduleDelivery(
            order.getShippingAddress(), 
            order.getItems()
        );
        
        // Thread blocks for notification (~20ms - 1s)
        notificationService.sendConfirmation(
            order.getCustomerEmail(), 
            shipping.getTrackingNumber()
        );
        
        // Total thread blocked time: potentially 40+ seconds
        // During this time, this thread cannot serve other requests
        return OrderResult.success(shipping.getTrackingNumber());
    }
}

The Hidden Cost of Blocking:

The code above looks clean and readable—sequential steps that are easy to follow. But the elegance masks a devastating problem: thread monopolization.

When a thread blocks waiting for I/O:

Memory is wasted: Each thread typically allocates 512KB to 2MB for its stack. A blocked thread's stack sits idle, consuming RAM for nothing.
Context switching overhead: When the I/O completes, the operating system must wake the thread and schedule it—thousands of blocking threads mean thousands of context switches.
Scalability ceiling: With a 200-thread pool and 2-second average blocking time, you can only handle 100 requests/second. Scaling requires adding more threads, which quickly hits diminishing returns.
Cascading failures: When a downstream service slows down, blocked threads accumulate. Thread pool exhaustion means new requests are rejected—one slow service brings down the entire system.

Thread Pool Exhaustion Under Load
Scenario	Threads Available	Avg. Block Time	Max Throughput	Status
Normal load	200	500ms	400 req/s	✅ Healthy
Spike in traffic	200 (all busy)	500ms	400 req/s	⚠️ Rejecting requests
Slow database	200 (all blocked)	5 seconds	40 req/s	❌ System degraded
External service timeout	200 (stuck)	30 seconds	~7 req/s	💀 System failure

The Blocking Paradox

The cleaner the blocking code looks, the worse it scales. Each sequential, easy-to-read blocking call is a potential thread denial-of-service waiting to happen. The simplicity is a trap—it works perfectly until load increases, then fails catastrophically.

The Polling Approach and Its Waste

To avoid the thread-blocking problem, an alternative approach is polling: instead of waiting for the result, periodically check if the operation has completed. This keeps the thread free between checks but introduces its own set of problems.

Polling appears to solve the blocking problem—threads aren't stuck waiting. But it trades one form of waste for another.

polling-example
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
// Polling approach - avoids blocking but wastes CPU
public class PollingOrderService {
    
    public OrderResult processOrderWithPolling(Order order) {
        // Submit payment request, get a ticket/receipt
        String paymentTicket = paymentGateway.submitPayment(
            order.getPaymentInfo()
        );
        
        // Poll for payment completion
        PaymentResult payment = null;
        while (payment == null) {
            PaymentStatus status = paymentGateway.checkStatus(paymentTicket);
            
            if (status == PaymentStatus.COMPLETED) {
                payment = paymentGateway.getResult(paymentTicket);
            } else if (status == PaymentStatus.FAILED) {
                return OrderResult.failed("Payment failed");
            } else {
                // Still pending - wait and retry
                // But how long should we wait?
                Thread.sleep(100); // Poll every 100ms
                // Problem: What if it completes at 50ms? We waited 50ms extra
                // Problem: What if it takes 10s? We made 100 unnecessary API calls
            }
        }
        
        // More polling for each subsequent step...
        String inventoryTicket = inventoryService.submitReservation(
            order.getItems()
        );
        
        InventoryResult inventory = null;
        while (inventory == null) {
            InventoryStatus status = inventoryService.checkStatus(inventoryTicket);
            if (status == InventoryStatus.RESERVED) {
                inventory = inventoryService.getResult(inventoryTicket);
            } else if (status == InventoryStatus.UNAVAILABLE) {
                paymentGateway.refund(payment.getTransactionId());
                return OrderResult.failed("Items unavailable");
            } else {
                Thread.sleep(50); // Different poll interval?
            }
        }
        
        // This pattern repeats, creating verbose, error-prone code
        // ...
        
        return OrderResult.success(/* tracking number */);
    }
}

The Polling Trade-offs:

Polling introduces a fundamental tension between latency and resource consumption:

Poll Too Frequently

•Wasted CPU cycles checking repeatedly
•Excessive network requests to status endpoints
•API rate limiting and quota exhaustion
•Increased costs in pay-per-request environments
•Potential DDoS of your own services

Poll Too Infrequently

•Delayed reaction to completion
•Increased end-to-end latency
•Poor user experience
•Wasted time waiting when result is ready
•Resources sit idle unnecessarily

Adaptive Polling Doesn't Solve the Fundamental Problem:

Sophisticated implementations use exponential backoff or adaptive polling intervals, but these are band-aids on a fundamentally broken model:

Initial poll interval: 10ms
Backoff factor: 1.5x
Max interval: 5s

Poll 1: 10ms → Status: PENDING
Poll 2: 15ms → Status: PENDING  
Poll 3: 22ms → Status: PENDING
Poll 4: 33ms → Status: PENDING
... (result ready at 60ms)
Poll 5: 50ms → Status: COMPLETE ✓

Actual completion: 60ms
We found out at: 130ms (50ms late)

No matter how sophisticated the polling algorithm, you're fundamentally in a reactive mode—you can never learn about completion immediately. The operation must actively push notification to avoid this waste.

The Polling Dilemma in Numbers

Consider 10,000 concurrent operations, each taking 1-10 seconds. With 100ms polling: you make 100-1,000 status checks per operation. That's potentially 10 million unnecessary API calls—just to learn when 10,000 operations complete. This is the waste that push-based notification eliminates.

The Callback Approach and Callback Hell

To address the inefficiencies of blocking and polling, the callback pattern emerged: instead of waiting or checking, you provide a function to be executed when the operation completes. This is fundamentally more efficient—no wasted cycles, no polling overhead. But callbacks introduce their own severe problems.

Callbacks represent a paradigm shift: instead of 'I will wait for the result,' you say 'When the result is ready, do this.' This inversion of control has profound implications for code structure and error handling.

callback-example
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
// Callback approach - solves efficiency, creates maintenance nightmare
function processOrder(order, onComplete, onError) {
    // Start payment processing, provide callback
    paymentGateway.processPayment(order.paymentInfo, 
        (paymentError, paymentResult) => {
            if (paymentError) {
                onError(new Error('Payment failed: ' + paymentError.message));
                return;
            }
            
            // Payment succeeded, now reserve inventory
            inventoryService.reserveItems(order.items,
                (inventoryError, inventoryResult) => {
                    if (inventoryError) {
                        // Must refund payment before reporting error
                        paymentGateway.refund(paymentResult.transactionId,
                            (refundError) => {
                                // What if refund also fails?
                                // Error handling becomes deeply nested
                                onError(new Error('Inventory failed, refund status: ' + 
                                    (refundError ? 'FAILED' : 'SUCCESS')));
                            }
                        );
                        return;
                    }
                    
                    // Inventory reserved, schedule shipping
                    shippingService.scheduleDelivery(
                        order.shippingAddress, 
                        order.items,
                        (shippingError, shippingResult) => {
                            if (shippingError) {
                                // Must release inventory AND refund payment
                                inventoryService.releaseItems(inventoryResult.reservationId,
                                    () => {
                                        paymentGateway.refund(paymentResult.transactionId,
                                            (refundError) => {
                                                onError(new Error('Shipping failed'));
                                            }
                                        );
                                    }
                                );
                                return;
                            }
                            
                            // Finally, send notification
                            notificationService.sendConfirmation(
                                order.customerEmail,
                                shippingResult.trackingNumber,
                                (notifyError) => {
                                    // Even if notification fails, order is complete
                                    // But we should probably log this somewhere
                                    if (notifyError) {
                                        logger.warn('Notification failed', notifyError);
                                    }
                                    onComplete({
                                        success: true,
                                        trackingNumber: shippingResult.trackingNumber
                                    });
                                }
                            );
                        }
                    );
                }
            );
        }
    );
}
 
// The "pyramid of doom" - callbacks nested 6+ levels deep
// Error handling is scattered and easy to miss
// Control flow is inverted and hard to follow
// Testing this code is a nightmare

The Seven Deadly Sins of Callback-Based Code:

Problems with Callback-Based Async Handling

•Callback Hell / Pyramid of Doom — Each async operation adds another nesting level. Code moves horizontally instead of vertically, becoming unreadable.
•Inversion of Control — You give up control flow to the async framework. You provide code to be called; you don't call code. This makes reasoning about execution order difficult.
•Error Handling Fragmentation — Every callback needs its own error handling. Miss one and errors silently disappear. Rollback logic must be duplicated at every level.
•No Return Values — Callbacks don't return values; they pass results to other callbacks. This prevents using results in expressions and forces imperative style.
•Composition Nightmare — Combining multiple async operations (parallel execution, racing, conditional branching) requires manual coordination with counters and flags.
•Testing Complexity — Testing callback-based code requires complex mocking and callback assertion patterns. Async test timeouts and race conditions abound.
•Cognitive Overhead — Developers must mentally trace callback invocation chains to understand code flow. The linear reading of code no longer maps to execution order.

Inversion of Control: The Hidden Problem

With callbacks, you give your continuation code to someone else to execute. You trust them to call it exactly once. You trust them to call it at all. You trust them to call it in the right context. You trust them to handle errors correctly. This implicit trust is often violated, leading to bugs that are extraordinarily difficult to trace.

Real-World Impact of These Problems

These aren't abstract concerns—they manifest as concrete problems in production systems. Every approach we've examined creates real engineering burden and real system failures.

Production Impact of Async Result Handling Approaches
Approach	Production Failure Mode	Detection Difficulty	Recovery Cost
Blocking	Thread pool exhaustion under load spikes	Easy (503 errors)	High (architecture change)
Blocking	Cascading failures when dependencies slow	Medium (gradual degradation)	Very High (circuit breakers needed)
Polling	API quota exhaustion	Easy (429 errors)	Medium (backoff tuning)
Polling	Latency increase under load	Medium (SLA breaches)	Medium (polling optimization)
Callbacks	Silent error swallowing	Very Hard (data inconsistency)	Very High (audit + fix)
Callbacks	Memory leaks from unclosed callbacks	Hard (slow memory growth)	High (profiling + rewrite)
Callbacks	Callback called multiple times	Very Hard (intermittent bugs)	Very High (defensive coding everywhere)

Case Study: The $50,000 Callback Bug

A real-world e-commerce platform had a payment processing flow using callbacks. Under specific timing conditions, the inventory reservation callback was executed before the payment callback, causing items to be shipped before payment confirmation. The bug was intermittent—appearing only under load—and went undetected for months.

The result:

847 orders shipped without payment confirmation
$50,000+ in unrecovered revenue
3 weeks of engineering time to diagnose and fix
Complete rewrite of the order processing pipeline

The root cause? Callback execution order wasn't guaranteed, and the code assumed sequential completion. There was no mechanism to express "this callback depends on that one completing first."

The Cost of Complexity

When async code is hard to reason about, developers make mistakes. When mistakes are hard to detect, they ship to production. When production bugs involve async timing, they're intermittent and nearly impossible to reproduce. Every layer of callback nesting is a layer of future debugging difficulty.

What We Need: Requirements for a Solution

Having dissected the failures of blocking, polling, and callbacks, we can now articulate what a proper solution must provide. This requirements analysis will set the stage for understanding why Future/Promise is such an elegant pattern.

A solution to the async result handling problem must:

Essential Requirements

•Non-blocking by nature — Operations must not monopolize threads while waiting. Resources should be freed for other work until the result is actually needed.
•Push-based notification — Completion should notify waiting code immediately, not require polling. Zero wasted cycles checking for completion.
•First-class representation — The 'eventual result' should be a value that can be stored, passed, returned from functions, and composed with other values. It should be a thing, not just a callback contract.
•Composable — Sequential operations (then this, then that) and parallel operations (do all these, wait for all) should be expressible concisely without manual coordination.
•Unified error handling — Errors should propagate through the chain without explicit handling at every step. A single error handler should capture failures from any step.
•Readable, linear code — The resulting code should read top-to-bottom like synchronous code, even though execution is asynchronous. Mental model should match execution.
•Cancelable — Long-running operations should be cancelable when results are no longer needed. Resources shouldn't be wasted on abandoned work.
•Testable — The solution should be easy to mock, stub, and test without complex async test setup.

The Conceptual Leap:

What if, instead of either:

Waiting for a value (blocking)
Checking if a value is ready (polling)
Providing code to run when a value is ready (callbacks)

We could:

Receive an object representing the eventual value
Operate on that object as if the value will exist
Compose operations on eventual values like regular values
Handle success and failure uniformly

This is the key insight: the result of an async operation isn't 'nothing yet'—it's a container for a value that will exist in the future. That container can be passed around, composed, and operated on. When the value arrives, all operations waiting for it execute.

This is the Future/Promise pattern—and it's the subject of our next page.

Foreshadowing the Solution

The Future/Promise pattern treats async operations as first-class values. Instead of callbacks that split code across functions, Promises chain operations linearly. Instead of manual error handling at each level, errors propagate automatically. Instead of nested pyramids, flat chains. The async world becomes as composable as the sync world.

Summary: The Async Result Handling Problem

We've done the hard work of understanding why async result handling is challenging before learning how to solve it. Let's consolidate what we've learned:

Key Takeaways

•Asynchronous operations are unavoidable at scale — Network I/O, file operations, external services, and long computations all require async handling to maintain system responsiveness.
•Blocking wastes threads — Each blocked thread consumes memory and CPU context-switch overhead. Under load, thread pool exhaustion causes cascading failures.
•Polling wastes resources — Repeated status checks consume CPU and network bandwidth. Latency vs. overhead is an unsolvable tension in polling-based approaches.
•Callbacks invert control and fragment code — The 'callback hell' pattern makes code unreadable, error handling difficult, and composition nearly impossible.
•All three approaches have real production failure modes — Silent bugs, thread exhaustion, and cascading failures are common in systems using these patterns.
•We need a first-class abstraction for eventual values — The ideal solution represents async results as composable objects with unified error handling and linear code flow.

What's Next:

Now that we deeply understand the problem, we're ready for the solution. The next page introduces the Future/Promise pattern—an abstraction that represents async computations as first-class values. You'll see how this single concept elegantly addresses every requirement we identified, transforming callback spaghetti into clean, composable, testable async code.

Page Complete

You now understand the fundamental challenges of asynchronous result handling: blocking wastes threads, polling wastes cycles, and callbacks create unmaintainable code. This understanding is essential—the Future/Promise pattern's elegance only becomes apparent when you've felt the pain of the alternatives.