Skip to content
Open navigation
OpenOpen workspace

Stack Overflow Developer Survey 2026

Effect of AI on satisfaction: Debugging/refactoring by work setting

In the Remote group, 34% answered “Greatly improved”; in the Your choice (very flexible, you can come in when you want or just as needed) group, 28% did. Across the table the answers differ by work setting, a negligible association: χ²(16, N = 10486) = 47.54, p < .001, V = .03. These are unweighted respondents, not population estimates.

Published by crosstabs.com · Last updated ·
How results are checkedNamed statistical review pending. Selected automated reference cases are published on the validation page.

The table

The table

Question asked: When using AI tools or AI agents at work, which of the following have increased or decreased your usual satisfaction with completing the task? Select one answer for each. Shown by work setting, as column percentages with the number of respondents beneath.

Effect of AI on satisfaction: Debugging/refactoring by work setting: column percentages and respondent counts
Effect of AI on satisfaction: Debugging/refactoringHybrid (some in-person, leans heavy to flexibility) (A)Hybrid (some remote, leans heavy to in-person) (B)In-person (C)Remote (D)Your choice (very flexible, you can come in when you want or just as needed) (E)All
Greatly improved29.6%49728.4%59729.1%42034.1%ABCE1,32427.8%38630.7%3,224
Somewhat improved36.6%61437.4%d78637.8%d54433.8%1,31335.2%48835.7%3,745
No change23.9%40123.2%48722.4%32322.2%86227.0%CD37423.3%2,447
Somewhat decreased5.5%926.4%1346.8%986.0%2335.8%816.1%638
Greatly decreased4.4%744.6%973.9%563.8%1484.1%574.1%432
Respondents1,6782,1011,4413,8801,38610,486

A letter beside a percentage names the columns it is significantly higher than (uppercase 95%, lowercase 90%; pairwise column tests, Bonferroni-corrected). 20,417 of 30,903 respondents have no answer to one of the two questions (not asked or not answered) and are left out.

Analysis

Results

Chi-square test

χ² = 47.54

df = 16, p < .001

Effect size

Cramér's V = 0.034

a negligible association

APA-style report: χ²(16, N = 10486) = 47.54, p < .001, V = .03. N = 10,486. Smallest expected count 57.1.

How to read it

The chi-square test rejects independence at the 0.05 level (p < .001): differences this large between the groups are unlikely if the answer did not depend on work setting. Cramér's V of 0.034 is in the negligible range, which is trivially weak in practical terms, even where a sample this large can detect it.

With 10,486 respondents, even small differences reach statistical significance. Read the percentages and the effect size before the p-value.

Limits

  • The survey has no weights. These tables are unweighted counts of the people who answered, so they describe the respondents, not developers in general.
  • The test treats respondents as a simple random sample. They are people who chose to answer a survey Stack Overflow promoted, not a random sample of developers, so a result holds for these respondents and may not hold beyond them.
  • A difference between groups is not evidence that group membership causes the answer.

Next steps

Work with this table

Open this table in the calculator

The link fills in every count and label. Merge answers, drop a group, and the statistics update.

Open this question in the full file

The workspace opens all 30,903 respondents in your browser with this question selected. The survey has no weights, so the table there is unweighted too. Change the group, add a filter or export from there.

Open in the workspace →

Run this on your own data — free, no signup

Upload a CSV, Excel, SPSS, Stata, SAS, R, Parquet or JSON file. Everything runs in your browser; your file never leaves your device.

Open the workspace →

The same question by other groups

Other questions that differ by work setting

Source

Stack Overflow. 2026 Developer Survey, https://survey.stackoverflow.co/2026, licensed under the ODbL 1.0. Tabulated by crosstabs.com. Variables AISat_4 (Effect of AI on satisfaction: Debugging/refactoring) and WorkSetting. Stack Overflow licenses the survey data under the Open Database License (ODbL) 1.0 and its contents under the Database Contents License (DbCL) 1.0: credit Stack Overflow, keep the licence notice, and share any database made from the data under the ODbL. These tables and their downloads are offered on those terms.

  1. [1]Stack Overflow: 2026 Developer Survey public results (survey_results_public.csv)survey.stackoverflow.co
  2. [2]Stack Overflow: Open Database License (ODbL) 1.0opendatacommons.org