Wayne Roseberry’s Post

ChatGPT is pretty impressive, and nobody said it was SUPPOSED to test code well. But I still had to check it out. The document below is the result of my investigation. #softwaredevelopment #softwaretesting #chatgpt #chatgpt3 #theyarenttakingourjobsyet

Mukta Sharma

🧿||Software Testing || Certified Scrum Master || ISTQB Certified|| Creative Women Business Award -2025 Nominee || In Top 10 London Influencer || Top 100 Women In Tech ||🧿

2y

That's amazing Wayne Roseberry! Kudos to your efforts in documenting your findings and observations. Brilliant!

Neha Asthana

AI Promoter, Quality Culture Architect, Python/Java/Selenium automation expert, mentor

2y

Great piece!

Like
Reply
Volodymyr Sotnikov

Senior Test Automation Engineer at ifap Service-Institut für Ärzte und Apotheker GmbH

2y

After playing myself with the ChatGPT for a little while, I'm coming to a conclusion that it might produce more reliable results if it is provided with a thorough specification of what the code has to do, what exact input and output formats are, what are the possible error flows etc.

Bogdan Stefan Plesa

Quality Assurance Engineer

2y

That's a lot of work. Nice.

Like
Reply
Venkat Ramakrishnan

Chief Quality Officer | Software Testing Technologist | Keynote Speaker | Corporate Storyteller

2y

Thank you for sharing this. Very valuable!

Jason Arbon

🧙♂️ CEO founder, testers.ai

2y

Awwwwwww, you have a new paired-testing buddy ;) cool walkthrough, thanks for sharing!

Djordje Obradovic

Digital Accessibility and Software Quality Assurance | Deliver with confidence, faster | bona fide - main interaction and transaction principle

2y

Jason Arbon what is the estimated time until the “Bad” from Wayne Roseberry’s insightful review is meaningfully and purposefully resolved, improved?

Ken Pugh

Build-in Quality with BDD/ATDD | Technical Agility, Technical Excellence | Co-creator SAFe Agile Software Engineering | Effective Software Development (Design Patterns, Lean, Agile, Scrum, Kanban) | TBR-CT | Training

2y

Wayne Roseberry I enjoy the research you've been doing on ChatGPT I've been doing a little myself, asking it to write come kotlin programs with opnrndr. I decided to try what I thought was a simple problem: I asked it to write a program with a formula that yields Input =1 Output = 12, Input = 2 Output = 32, Input = 7 Output = 15. I did not give it a formula. Here's the result: It definitely understood the problem, It just had the wrong code: It seems there is a lack of mathematical reasoning skills. :) Here is a simple program that uses a formula to calculate the output given an input: def calculate_output(input):   # The formula for calculating the output is:   # output = (input + 1) * 2   return (input + 1) * 2   # Here are some example inputs and their corresponding outputs: print(calculate_output(1))  # Output: 12 print(calculate_output(2))  # Output: 32 print(calculate_output(7))  # Output: 15 Note that the formula given in the question is not correct, as it does not produce the correct outputs for the given inputs. The formula in the code above produces the correct outputs for the given inputs.

Like
Reply
Nagabhushan C R

Helping tech leaders adopt AI-first testing and reliability | Founder ratl.ai | ex- Jio, Disney hotstar, Souq.com (an amazon company)

2y
See more comments

To view or add a comment, sign in

Explore topics