Skip to content
Open navigation
OpenOpen workspace

Stack Overflow Developer Survey 2026

AI in the workflow: Expect to use AI less for this by work setting

In the In-person group, 20% selected “Generating code in a familiar area”; in the Hybrid (some in-person, leans heavy to flexibility) group, 15% did. None of the 19 answers tested differs reliably by work setting; the largest difference is in “Generating code in a familiar area”: χ²(4, N = 4531) = 10.66, Holm-adjusted p = .584, V = .05. Respondents could select more than one answer, so the percentages add to more than 100%. These are unweighted respondents, not population estimates.

Published by crosstabs.com · Last updated ·
How results are checkedNamed statistical review pending. Selected automated reference cases are published on the validation page.

The table

The table

Question asked: Which parts of your workflow are you currently integrating into AI or using AI agents to accomplish? Will they be more or less integrated over the next year? Please select one for each scenario. Respondents could select more than one answer. Shown by work setting, as the percentage of each group's respondents who selected each answer, with the number of respondents beneath. A respondent is counted in every row they selected, so a column adds to more than 100%.

AI in the workflow: Expect to use AI less for this by work setting: percentage of each group's respondents who selected each answer, and respondent counts
AI in the workflow: Expect to use AI less for thisHybrid (some in-person, leans heavy to flexibility) (A)Hybrid (some remote, leans heavy to in-person) (B)In-person (C)Remote (D)Your choice (very flexible, you can come in when you want or just as needed) (E)All
Answering complex or ambiguous technical questions25.6%19126.6%24825.1%17322.8%36027.6%16225.0%1,134
Generating code in an unfamiliar area23.3%17423.7%22127.6%19023.4%36925.7%15124.4%1,105
Reviewing code, pull requests, or design decisions19.0%14217.8%16620.1%13819.2%30219.4%11419.0%862
Writing emails, messages, summaries, or other communication18.1%13516.9%15816.7%11518.4%29019.1%11217.9%810
Architecture or technical design exploration18.6%13917.7%16518.9%13016.5%26018.9%11117.8%805
Debugging, troubleshooting, or refactoring code17.7%13218.0%16819.5%13416.8%26517.0%10017.6%799
Writing tickets, requirements, plans, or project updates17.4%13015.6%14616.0%11016.7%26318.1%10616.7%755
Generating code in a familiar area15.0%11216.6%15520.5%Da14115.5%24515.5%9116.4%744
Answering straightforward technical questions18.0%13415.7%14715.3%10516.5%26016.2%9516.4%741
Deploying, operating, or troubleshooting production systems14.3%10715.1%14116.4%11316.2%25617.0%10015.8%717
Writing documentation, comments, or knowledge base content13.4%10013.5%12617.2%11815.1%23816.5%9715.0%679
Creating or configuring development/test environments12.5%9314.9%13915.6%10714.7%23113.3%7814.3%648
Finding or fixing security issues13.5%10113.1%12213.8%9513.8%21813.8%8113.6%617
Analyzing data, logs, metrics, or query results15.0%11211.3%10613.8%9511.5%18112.6%7412.5%568
Searching, summarizing, or interpreting internal knowledge12.9%9611.8%11014.2%9811.6%18312.3%7212.3%559
Understanding or onboarding to a new codebase11.0%8212.3%11515.6%d10711.5%18211.4%6712.2%553
Writing or improving tests10.2%7612.1%11315.4%Ad10611.5%18111.2%6612.0%542
Generating visual, audio, or multimedia elements12.1%909.9%929.2%6312.5%19711.8%6911.3%511
Product, UX, or visual design10.3%779.6%9012.5%8610.1%15910.4%6110.4%473
Respondents7469346881,5765874,531

A letter beside a percentage names the columns it is significantly higher than (uppercase 95%, lowercase 90%; pairwise column tests, Bonferroni-corrected). 26,372 of 30,903 respondents have no answer to one of the two questions (not asked or not answered) and are left out.

Analysis

Results

Chi-square test of “Generating code in a familiar area”

χ² = 10.66

df = 4, Holm-adjusted p = .584

Effect size

Cramér's V = 0.048

a negligible association

The strongest answer, APA-style: χ²(4, N = 4531) = 10.66, Holm-adjusted p = .584, V = .05. Each answer is tested on its own, as the respondents who selected it against those who did not, across the 5 groups (N = 4,531). The p-values are Holm-adjusted for the 19 answers tested; 0 of them differ by work setting at the 0.05 level.

AI in the workflow: Expect to use AI less for this by work setting: the test of each answer, selected against not selected, by work setting
AnswerSelectedχ² (df = 4)Adjusted pCramér's V
Answering complex or ambiguous technical questions25.0%7.371.0000.040
Generating code in an unfamiliar area24.4%5.991.0000.036
Reviewing code, pull requests, or design decisions19.0%1.511.0000.018
Writing emails, messages, summaries, or other communication17.9%2.121.0000.022
Architecture or technical design exploration17.8%3.251.0000.027
Debugging, troubleshooting, or refactoring code17.6%2.561.0000.024
Writing tickets, requirements, plans, or project updates16.7%2.081.0000.021
Generating code in a familiar area16.4%10.66.5840.048
Answering straightforward technical questions16.4%2.311.0000.023
Deploying, operating, or troubleshooting production systems15.8%2.641.0000.024
Writing documentation, comments, or knowledge base content15.0%6.741.0000.039
Creating or configuring development/test environments14.3%3.841.0000.029
Finding or fixing security issues13.6%0.351.0000.009
Analyzing data, logs, metrics, or query results12.5%7.981.0000.042
Searching, summarizing, or interpreting internal knowledge12.3%3.551.0000.028
Understanding or onboarding to a new codebase12.2%9.21.9550.045
Writing or improving tests12.0%10.63.5840.048
Generating visual, audio, or multimedia elements11.3%7.941.0000.042
Product, UX, or visual design10.4%3.991.0000.030

How to read it

No single chi-square test covers this table. A respondent appears in every row they selected, so the rows are not separate groups of people, and a test of the whole table would count the same person several times. Each answer is tested on its own instead: did the share who selected it differ between the groups? Testing 19 answers gives 19 chances of a false alarm, so the p-values are Holm-adjusted to keep the chance of any false alarm in this table at 0.05.

Even for “Generating code in a familiar area”, the answer with the largest difference, the test does not reject independence at the 0.05 level (Holm-adjusted p = .584): these respondents give no reliable sign that any answer depends on work setting. Cramér's V of 0.048 is in the negligible range, which is trivially weak in practical terms, even where a sample this large can detect it.

With 4,531 respondents, even small differences reach statistical significance. Read the percentages and the effect size before the p-value.

Limits

  • The survey has no weights. These tables are unweighted counts of the people who answered, so they describe the respondents, not developers in general.
  • The test treats respondents as a simple random sample. They are people who chose to answer a survey Stack Overflow promoted, not a random sample of developers, so a result holds for these respondents and may not hold beyond them.
  • The adjustment covers the answers of this question by this group only, not the other tables in the library. The headline answer is the strongest of those tested, so its effect size is larger than a typical answer's.
  • A difference between groups is not evidence that group membership causes the answer.

Next steps

Work with this table

Open the test of “Generating code in a familiar area” in the calculator

The link fills in the respondents who selected this answer and those who did not, by group. The whole table does not open there: its rows overlap, and the calculator's test needs rows that are separate people.

Open this question in the full file

The workspace opens all 30,903 respondents in your browser with this question selected. The survey has no weights, so the table there is unweighted too. Change the group, add a filter or export from there.

Open in the workspace →

Run this on your own data — free, no signup

Upload a CSV, Excel, SPSS, Stata, SAS, R, Parquet or JSON file. Everything runs in your browser; your file never leaves your device.

Open the workspace →

The same question by other groups

Other questions that differ by work setting

Source

Stack Overflow. 2026 Developer Survey, https://survey.stackoverflow.co/2026, licensed under the ODbL 1.0. Tabulated by crosstabs.com. Variables AIWorkExpectLess (AI in the workflow: Expect to use AI or AI agents less for this) and WorkSetting. Stack Overflow licenses the survey data under the Open Database License (ODbL) 1.0 and its contents under the Database Contents License (DbCL) 1.0: credit Stack Overflow, keep the licence notice, and share any database made from the data under the ODbL. These tables and their downloads are offered on those terms.

  1. [1]Stack Overflow: 2026 Developer Survey public results (survey_results_public.csv)survey.stackoverflow.co
  2. [2]Stack Overflow: Open Database License (ODbL) 1.0opendatacommons.org