Stack Overflow Developer Survey 2026
Usefulness of AI: Debugging/refactoring by attitude toward ai
In the Very favorable group, 59% answered “Very useful”; in the Somewhat unfavorable group, 14% did. Across the table the answers differ by attitude toward ai, a medium association: χ²(20, N = 12513) = 2593.93, p < .001, V = .23. These are unweighted respondents, not population estimates.
How results are checked
Named statistical review pending. Selected automated reference cases are published on the validation page.The table
The table
Question asked: When using AI tools or AI agents at work, how useful has AI proven itself for the task or activity? Select one answer for each.
Shown by attitude toward ai, as column percentages with the number of respondents beneath.
| Usefulness of AI: Debugging/refactoring | Very favorable (A) | Somewhat favorable (B) | Neutral (C) | Somewhat unfavorable (D) | Very unfavorable (E) | Not sure (F) | All |
|---|---|---|---|---|---|---|---|
| Very useful | 59.4%BCDEF2,387 | 30.0%CDE1,140 | 19.2%D355 | 13.7%253 | 16.8%146 | 31.5%CDE39 | 34.5%4,320 |
| Useful | 30.0%1,204 | 45.3%ADE1,721 | 42.1%AE780 | 40.9%AE754 | 30.4%264 | 37.1%46 | 38.1%4,769 |
| No strong opinion | 6.4%257 | 14.3%A545 | 21.2%ABE392 | 20.2%ABe373 | 15.7%A136 | 13.7%A17 | 13.7%1,720 |
| More impractical than useful, not useful | 2.1%86 | 5.8%A221 | 10.7%AB198 | 17.7%ABCF327 | 29.8%ABCDF259 | 7.3%A9 | 8.8%1,100 |
| Not applicable | 2.1%86 | 4.6%A175 | 6.9%AB128 | 7.5%AB138 | 7.4%AB64 | 10.5%AB13 | 4.8%604 |
| Respondents | 4,020 | 3,802 | 1,853 | 1,845 | 869 | 124 | 12,513 |
A letter beside a percentage names the columns it is significantly higher than (uppercase 95%, lowercase 90%; pairwise column tests, Bonferroni-corrected). 18,390 of 30,903 respondents have no answer to one of the two questions (not asked or not answered) and are left out.
Analysis
Results
Chi-square test
χ² = 2593.93
df = 20, p < .001
Effect size
Cramér's V = 0.228
a medium association
APA-style report: χ²(20, N = 12513) = 2593.93, p < .001, V = .23. N = 12,513. Smallest expected count 6.0.
How to read it
The chi-square test rejects independence at the 0.05 level (p < .001): differences this large between the groups are unlikely if the answer did not depend on attitude toward ai. Cramér's V of 0.228 is in the medium range, which is of moderate strength: a clearly visible pattern in the table.
With 12,513 respondents, even small differences reach statistical significance. Read the percentages and the effect size before the p-value.
Limits
- The survey has no weights. These tables are unweighted counts of the people who answered, so they describe the respondents, not developers in general.
- The test treats respondents as a simple random sample. They are people who chose to answer a survey Stack Overflow promoted, not a random sample of developers, so a result holds for these respondents and may not hold beyond them.
- A difference between groups is not evidence that group membership causes the answer.
Next steps
Work with this table
Open this table in the calculator
The link fills in every count and label. Merge answers, drop a group, and the statistics update.
Open this question in the full file
The workspace opens all 30,903 respondents in your browser with this question selected. The survey has no weights, so the table there is unweighted too. Change the group, add a filter or export from there.
Open in the workspace →Run this on your own data — free, no signup
Upload a CSV, Excel, SPSS, Stata, SAS, R, Parquet or JSON file. Everything runs in your browser; your file never leaves your device.
Open the workspace →The same question by other groups
Other questions that differ by attitude toward ai
- First actions when trying to solve a problem by attitude toward ai
- Effect of AI on satisfaction: Implementation by attitude toward ai
- What prevents taking part in technical communities by attitude toward ai
- Usefulness of AI: Implementation by attitude toward ai
- AI in the workflow: Do not use AI for this and do not plan to by attitude toward ai
- Tasks delegated to AI agents by attitude toward ai
Source
Stack Overflow. 2026 Developer Survey, https://survey.stackoverflow.co/2026, licensed under the ODbL 1.0. Tabulated by crosstabs.com. Variables AIImpact_4 (Usefulness of AI: Debugging/refactoring) and AISentiment. Stack Overflow licenses the survey data under the Open Database License (ODbL) 1.0 and its contents under the Database Contents License (DbCL) 1.0: credit Stack Overflow, keep the licence notice, and share any database made from the data under the ODbL. These tables and their downloads are offered on those terms.