Bottom line
- No H100 / B200 does not mean no advanced AI compute. Split the load: training, inference, and agent execution are three tracks—do not bolt them to one controlled SKU.
- BIS guidance of 2026-05-31 states that entities headquartered in D:5 (including China) or Macau, or whose ultimate parent is, still need a license to receive advanced computing items anywhere. A third-country data center is not a legal bypass.
- Most product and agent teams should buy tokens (APIs), not cards. Cloud GPUs exist only for a contractable, reviewable entity that must host its own weights.
- Domestic AI chips (Ascend, Cambricon, and peers) fit teams that can port graphs and pay CUDA-migration cost—not teams that need stock CUDA kernels tomorrow.
- Cloud Mac hosts MCP, signing, and always-on agents. It does not replace datacenter GPUs. Lid-close retries repurchase the same inference.
Whether you can buy a chip is not the watershed. Which compliant track each workload sits on is.
0. Bottom line
As of 2026-09-08, US NVIDIA AI chip export restrictions have moved from H100 / H200 / Blackwell to licensed H20 and a blocked, down-binned B30A. China, in parallel, is pushing state-funded datacenters onto domestic accelerators and may require unfinished sites to pull foreign parts. The old answer—“just get a flagship card into the room”—is dead.
Working contrasts for people who must decide this week:
- Product inference / agent loops: default to tokens. DeepSeek, Qwen, Gemini, and Claude sell advanced capability as an API without moving controlled silicon. Cost math: DeepSeek V4-Flash token cost.
- Must train or fine-tune: port to a domestic cluster if you can change the graph. Licensed cloud GPU only if the ultimate parent is demonstrably not D:5. A “Singapore subsidiary + China HQ” is not a license exception.
- Third-country data centers: for China-headquartered buyers after mid-2026 this is a licensing and enforcement question, not a grey shortcut. Read the BIS 2026-05-31 guidance and NVIDIA export compliance.
- Execution: MCP, Keychain, xcodebuild, always-on agents belong on Cloud Mac—not on the same controlled packing list as training GPUs.
GPU versus Mac for inference throughput is a different cut; see NVIDIA GTC Berlin 2026: rent a GPU or a Mac.
1. Why the old plan died after export limits
Teams equated “advanced AI compute” with “an NVIDIA flagship in our cage.” After 2022 the US pulled A100, H100, and later Blackwell into advanced-computing controls by performance density and interconnect. China-only bins (A800 / H800 / H20) appeared; each time they approached cluster-scale frontier training, the rule tightened. In 2025–2026 H20 moved to licensing and B30A was treated like a full restriction because clusters could still train large models.
Beijing also told state-funded builds to use domestic chips, and early-stage sites may have to remove foreign accelerators already installed. That produced a bad intuition: the only remaining moves are grey-market cards or a rack in a third country. For an engineering team that is the most expensive intuition—it binds compliance risk, delivery comms, and CUDA lock-in without shipping next week’s agent.
- Controls attach to the item plus the end-user entity, not the flag on the cage. See 15 CFR 742 and the BIS memo.
- After clouds tightened KYC on D:5-headquartered customers, a third-country contract does not auto-deliver H100s.
- Grey-market cards have no driver support, no interconnect warranty, and no lawful path to put weights in production.
The real question is not “can China still buy NVIDIA.” It is how much of your load must host weights, how much can be tokens, and how much is just an execution host pretending to be FLOPS.
2. Five compute tracks
2.1 Track A: model APIs / buy tokens
Entry is an API key or an enterprise contract. Execution is inference, tool calls, long context. Context is the prompts and files you are allowed to send. Cost is per million tokens; the boundary is the vendor’s residency and training clauses. This is the default advanced compute for most China-built products and outbound agents in 2026. Do not paste a “train 70B” purchase order onto a support bot.
2.2 Track B: licensed cloud GPU
Entry is AWS / Azure / GCP / a licensed GPU cloud. Execution is CUDA training and self-hosted inference. Cost is GPU-hours plus egress plus idle. The boundary is who signs, where the ultimate parent sits, and whether the cloud treats the order as a licensable re-export. The track exists only if the entity survives that review.
2.3 Track C: third-country data center
On the brochure: a cage in Malaysia, Thailand, Singapore, or the UAE and a “local company.” After 2026-05-31, BIS restated that advanced computing items destined for D:5 / Macau-headquartered entities—or those whose ultimate parent is—need a license regardless of where the recipient is incorporated. Bona fide operators acting consistently with the EAR need not, for now, halt existing use because of that memo. That is not a new door for China-HQ buyers to purchase cards. Writing “third-country DC bypasses NVIDIA export limits” into a launch plan is betting the milestone on an enforcement holiday.
2.4 Track D: domestic AI chips
Huawei Ascend, Cambricon, Biren, Moore Threads run CANN or their own runtimes—not a transparent CUDA swap. Start at the Ascend community. Execution covers training and inference if you rewrite graphs, comms, and telemetry. Context is a domestic cluster and domestic residency. Cost is engineer-months plus power, not a USD sticker on one SKU. State-funded projects almost have to live here.
2.5 Track E: heterogeneous execution (Cloud Mac / Apple silicon)
Entry is SSH / VNC to a cloud or local Mac. Execution is MCP, signing, worktrees, on-device Core ML—not H100 training. Low-concurrency prototypes can try small models in unified memory; production throughput still returns to APIs or GPUs. Memory as the real bottleneck: Mac mini as an AI agent server. Automating rental billing: FOSSBilling compute-rental platform.
3. Comparison with one header set
Put third-country cages, cloud GPUs, domestic chips, APIs, and the execution host in one table so you do not only ask “is it CUDA.”
| Layer / option | Entry | Execution | Context | Cost | Permission boundary |
|---|---|---|---|---|---|
| API / tokens | Key / enterprise contract | Inference, tools, long context | Prompts and allowed files | Per million tokens; retries double | Vendor residency and training use |
| Licensed cloud GPU | Console / committed use | CUDA train + self-host infer | Weights you put in a VPC | GPU-hours + idle + egress | Signing entity and ultimate parent |
| Third-country DC | Overseas cage contract | Looks like cloud GPU on paper | Country of cage ≠ license exception | Rent + diligence + enforcement risk | BIS looks at HQ, not the sticker |
| Domestic AI chips | Domestic cloud / own hall | Train/infer on a native stack | Domestic data and tooling | Migration months + power | Almost mandatory for fiscal builds |
| Cloud Mac execution | SSH / cloud Mac | MCP, signing, always-on agents | Repos, certs, Keychain | Day-lease host, not FLOPS | Process user and egress |
Asymmetric line: swapping the cage to another country does not erase “ultimate parent in China.” A cheaper domestic card also does not stop an agent from rebilling tokens after a lid close. The SKU is a tick on the track.
4. Scenario matrix
| Layer / option | Entry | Execution | Context | Cost | Permission boundary |
|---|---|---|---|---|---|
| Support / coding agent, low QPS | API default | Flash or domestic API, cap steps | Short context + cached system | Budget output 3–8× input | Keys only on the backend |
| Fine-tune 7B–70B, can port | Domestic cluster | Ascend / Cambricon train stack | Data stays in-country | People-months > card price | Fiscal or domestic compliance first |
| Independent non-D:5 ultimate parent | Licensed cloud GPU | Short CUDA rental to prove | VPC + key rotation | Daily then commit | Counsel clears BIS / cloud KYC first |
| China HQ + overseas cage wish | Do not default here | Assume the license is denied | Third-country paper is not enough | Diligence often exceeds API cost | Read BIS; keep it out of the launch plan |
| iOS / MCP / always-on orchestration | Cloud Mac + API | Mac executes, does not train | Certs and DerivedData stay on Mac | Day-lease machine + tokens | Keychain never leaves the box |
| State-funded datacenter | Domestic chips | Ship the bid stack | Domestic residency | Write migration into the schedule | Foreign accelerators may have to come out |
5. Recommended stacks
A | Default product (most teams) Domestic or global API inference → step cap + daily USD → MCP / signing on Cloud Mac → no controlled NVIDIA flagship purchase B | Must self-train Ascend / Cambricon cluster → port one real training graph first → rewrite comms and monitors with it → keep live inference on an API C | Compliant overseas entity Counsel confirms ultimate parent → short licensed cloud-GPU cycle → egress and key rotation in the runbook → no third-country shell as a license D | Fiscal / localization project 100% domestic accelerators → lock CANN (or bid stack) in the SOW → never put “wait for B30A relief” on the critical path
6. Pitfalls
- Pitfall 1: Singapore / Malaysia cage = lawful H100. BIS looks at the ultimate parent’s HQ, not the sticker on the rack.
- Pitfall 2: Advanced AI requires owned NVIDIA. Most live requests are inference; tokens already are advanced compute.
- Pitfall 3: Domestic chips are “weaker CUDA.” They are another stack. No operator port, no compute.
- Pitfall 4: Grey-market cards in production. No drivers, no interconnect warranty, no compliance path.
- Pitfall 5: Cloud GPU quotes with no entity on the page. Failed KYC turns the GPU-hour contract into paper.
- Pitfall 6: Running the agent on a laptop, then blaming GPU shortage. Lid-close retries buy tokens, not cards.
- Pitfall 7: Reading export rules as “China never gets any NVIDIA.” Licenses, bins, and windows move. Write the plan on tracks, not rumored SKUs.
7. Seven steps
- Split next week’s load into train / infer / execute. Ban “everything needs H100.”
- Pick an API for the infer column (DeepSeek API docs or your domestic model host) and measure tokens on the real prompt.
- Draw the entity map against BIS 2026-05-31: HQ, ultimate parent, cloud account. China HQ → do not put a third-country cage in the design.
- If you must train, pick a domestic stack and port one graph that can reproduce loss before you fill a hall.
- Open a short licensed cloud-GPU PoC only after the entity survives cloud and export review.
- Move MCP, signing, and always-on orchestration to Cloud Mac so lid-close retries die. Boundaries: MCP on Cloud Mac vs VPS vs local.
- Publish a one-pager: default API, train domestic, no grey market, no third-country bypass. Reconcile invoice and entity monthly.
8. FAQ
Can a third-country data center bypass NVIDIA export limits?
Not for entities headquartered in China or Macau, or whose ultimate parent is. BIS (2026-05-31) says advanced computing items still need a license worldwide for those entities. A rack in Malaysia or Singapore is not a legal bypass.
No H100 means no advanced AI?
Most products and agents do not need owned H100s. Buy inference via API; train on a domestic stack you can port, or on licensed cloud GPU under a compliant entity. The gap is the track, not one SKU.
Can domestic AI chips replace CUDA?
Partly for training and inference, not as a default for every CUDA kernel. Ascend and Cambricon have their own stacks. Cost lives in operators, interconnect, and tooling—not poster FLOPS.
Cloud GPU or tokens?
Low-concurrency products and agent loops usually win on tokens and time-to-prod. Rent GPUs when you must fine-tune, keep long context on your own cards, or the API fails latency or residency checks.
Is Cloud Mac a datacenter GPU?
No. It hosts MCP, signing, always-on agents, and on-device checks. Inference stays on APIs or GPUs. Lid-close retries repurchase tokens.
9. Summary
After NVIDIA AI chip export restrictions in 2026, Chinese teams get advanced AI compute by splitting tracks—not by hunting a flagship card for the cage. A third-country data center is not a bypass for D:5-headquartered entities. Cloud GPU serves only contracts that survive entity review. Domestic AI chips serve portable training and fiscal builds. API tokens serve most live inference.
Order of work: split the load → infer on APIs → draw the ultimate parent → train on domestic or licensed cloud → execute on Cloud Mac → delete “third-country cage as bypass” from the milestone list. Rules will move; tracks should not be rewritten weekly.
Buy compute on a track; do not chain execution to a closed laptop
Export rules decide which card you cannot buy. They do not decide whether an agent rebills the same inference after the lid closes. Keep MCP, the repo, and signing on an always-on M-series Cloud Mac. Infer on an API or a GPU you can lawfully hold; train on a stack you can port. Day-lease acceptance, then monthly lock-in, so every million tokens hit a real step instead of a retry.