Wednesday, December 27, 2023

Originality over convention

Writing has long been a tightrope walk between adherence to convention and the pursuit of originality. Historically, deviating from established norms could brand you as uneducated, while a lack of originality risked the label of being clichéd. This delicate balance has been fundamentally disrupted by the advent of AI in writing, or "wraiting" as I like to call it.

In the pre-AI era, convention held significant value. It was a measure of education and intelligence, a yardstick to judge the clarity and correctness of one's thoughts. However, AI's ability to effortlessly follow these conventions has suddenly diminished their value. Originality has emerged as the sole contender in the arena of writing excellence. 

This seismic shift has understandably ruffled feathers. Many derive a sense of pride and authority from mastering and teaching these conventions. Yet, they now find themselves in a world where these skills are increasingly automated. This change isn't subject to debate or democratic process - it's an unstoppable wave reshaping the landscape.

Ironically, while AI excels in adhering to conventions, it's not inherently original. It can replicate, recombine, and reformat existing ideas, but the spark of true originality still lies uniquely within the human mind. This realization should be a beacon for writers in the AI era. The challenge is no longer about mastering the rules of writing but about pushing the boundaries of creativity and originality.

The implications for education are profound. Traditionally, a significant portion of writing education focused on teaching the rules – grammar, structure, formats. Now, these aspects can be delegated to AI tools. This frees educators to focus more on cultivating creativity, critical thinking, and originality. It's a shift from teaching the mechanics of writing to exploring the depths of imagination and expression.

For those resistant to this change, the path ahead may seem daunting. It involves unlearning the supremacy of convention and embracing a world where originality reigns supreme. However, this change is not a loss but an evolution. It's an opportunity to rediscover the essence of writing as an art form, where the value lies not in the adherence to rules but in the ability to transcend them.

In conclusion, the advent of AI in writing presents an opportunity for a paradigm shift. It's a call to writers and educators alike to redefine what constitutes good writing. As we navigate this new landscape, our focus should shift from convention to creativity, from format to imagination, ensuring that the heart of writing remains a distinctly human endeavor.

Wednesday, December 20, 2023

AI Pedagogy, the introduction

  1. AI-powered chatbot is a tool. By aiding, any other tool displaces human skills. For example, CAD displaced manual drafting, and word processor/printer displaced penmanship. Educators have an ethical obligation to prepare students for the world where the tool is used, not for the world where it does not exist. Skill displacement is expected.

  2. Writing with AI, or ‘wraiting,’ is an advanced and complex cognitive skill set, mastering which should be associated with students’ cognitive growth. It partially overlaps with traditional writing but does not coincide with it. Eventually, "wraiting" instruction should replace writing instruction.

  3. The default is to allow or require students to use AI. The only reasonable exception is when the use of AI prevents the development of a truly foundational skill. The pragmatic difficulties of policing the use of AI make it even more urgent to develop a rational justification for any restrictions.

  4. In some cases, the displaceable skill is foundational for learning higher-level skills. For example, basic literacy is not a displaceable skill because it is foundational for many other higher-level literacy skills. Therefore, limitations on the use of certain tools in education may be justifiable, although they may not be arbitrary.

  5. There must be rational criteria for distinguishing between displaceable and foundational skills. An assumption that all skills associated with traditional writing instruction are foundational is just as unreasonable as the assumption that they all are displaceable. The arguments about strict linearity of curriculum are not valid. Just because we used to teach certain skills in a certain progression does not mean that some of these skills cannot be displaced by AI or other tools.

  6. A skill is foundational and non-displaceable if:

    1. It is needed for pre-AI and non-AI tasks, or is needed to operate AI. 

    2. It is demonstrably needed to develop post-AI skills such as original, critical, creative,  and discerning thinking (OCCD thinking).

  7. Rather than worrying about students cheating, instructors should make an effort to make their assignments cheat-proof. The key strategies are these:

    1. Asking to submit sequences of prompts to assess student development.

    2. Refocusing evaluation rubric to focus on OCCD thinkingб ву-emphasizing displaceable skills

    3. Raise expectations by considering content produced via a lazy prompt to be the base level, failing product

  8. Each of the uses of AI are unique, and raise different questions and concerns. Their use in instruction should be evaluated separately. These are some examples with :

    1. Aggregator of information

      1. Tell me what is known about global warming

      2. Which philosophers are most notable in virtue ethics?

      3. Remind me what Cohen’s d is in statistics.

    2. Coach/Tutor/Counselor

      1. Test my knowledge of Spanish

      2. I feel overwhelmed and disengaged. What can I do?

      3. Give me some problems that are likely to be on GRE test, and explain what I did wrong

      4. Teach me how to [...] using Socratic dialogue, where you ask leading questions, and respond depending on my answers. Present your questions one by one

    3. Data processor

      1. Run multiple regression analysis on this data

      2. Summarize transcript, examine it for main themes and do sentiment analysis

      3. Give me keywords for each of these text segments

      4. Put data from this copied webpage into a table. I only need first name, last name, email. 

    4. Brainstorming partner

      1. I am thinking of writing a paper on… Which theories I should rely on? Who are the key authors?

      2. I have this idea… Has anyone else been offering an idea like this? Is it original?

      3. How would you build an argument, what supporting and opposing points should I consider? 

      4. I have these empirical data. What claims can I make based on them? 

    5. Feedback provider

      1. Give me feedback on my paper. Use the rubric it is going to be graded on

      2. What do you think I should do to improve this paper? 

      3. Give me feedback on my lesson plan

    6. Ghost writer

      1. Write a section of my paper; use these key ideas

      2. Elaborate and elucidate this fragment

    7. Editor and copy editor

      1. Give me feedback on the paper I just uploaded. Which parts need elaboration? Which parts may be redundant, which - too wordy?

      2. Revise this segment for clarity

      3. Revise the segment for grammar only

Monday, December 18, 2023

The prevailing mood of the discussion about AI in Education

This is the continuation of the analysis of the data set described in the previous blog, just with a different question. Obviously, I not endorse the bot's opinions or conclusions. 

Can you assess the prevailing mood based on the speech patterns?

GPT

  1. The prevailing mood in the digital ethnography of educators' discussions about AI in the classroom can be assessed through an analysis of the speech patterns and thematic content:
  2. Curiosity and Experimentation: There is a strong sense of curiosity and willingness to experiment with AI tools in the educational context. Educators are actively seeking information, sharing experiences, and exploring novel applications of AI in teaching various subjects, including special needs education​​. This exploratory tone suggests a generally positive and open attitude towards AI in education.
  3. Cautious Optimism: While there's an evident enthusiasm for the potential of AI, it's tempered with caution. Educators express concerns about privacy, data security, and the ethical implications of using AI tools, indicating a balanced view where optimism coexists with awareness of potential risks​​.
  4. Collaborative Engagement: The interactions reflect a collaborative mood among educators. They are keen on sharing insights, tips, and experiences, indicating a supportive community environment. This collaborative tone is indicative of a positive and community-oriented approach towards problem-solving and knowledge sharing​​.
  5. Practical Focus: There's a pragmatic focus on how AI can be utilized effectively in teaching and administrative tasks. Educators discuss practical applications such as grading, writing recommendation letters, and creating lesson plans, demonstrating a goal-oriented and practical mood towards AI integration​​.
  6. Concern and Vigilance: Amidst the enthusiasm, there's a discernible mood of concern, particularly regarding data privacy and the ethical use of AI. Educators are vigilant about the implications of AI use, suggesting a mood of responsibility and conscientiousness in adopting new technologies​​.
  7. Desire for Professional Growth: The discussions reveal a desire for professional development and a deeper understanding of AI tools. This indicates a mood of ambition and eagerness for growth and learning within the educator community​​.

In summary, the prevailing mood in the conversation is one of cautious optimism, characterized by a blend of enthusiasm and curiosity about AI's possibilities in education, tempered by a responsible and vigilant approach to its challenges and implications. This mood is underpinned by a collaborative spirit and a practical focus on leveraging AI for educational enhancement.

Can you give a list of the 10 most original ideas?

GPT

Based on the digital ethnography of the educators' discussion, the following can be considered the ten most original ideas for AI application in education:

  1. AI-Powered Grading Assistance: Using AI to assist in grading student work, with a focus on providing detailed feedback and reducing the time educators spend on this task​​.
  2. Historical Chatbots for Interactive Learning: Employing AI chatbots to simulate historical figures or situations, enhancing engagement and understanding in subjects like history and social studies​​.
  3. AI for Writing Recommendation Letters: Utilizing AI to draft initial versions of recommendation letters, thereby streamlining the process while maintaining personalization and authenticity​​.
  4. AI-Generated Teaching Materials and Lesson Plans: Leveraging AI to create customized teaching materials and lesson plans, particularly for language teaching and online education​​.
  5. Chatbots for Special Needs Education: Exploring the use of AI chatbots in special needs education to provide tailored learning experiences and support​​.
  6. AI in Early Childhood Education: Investigating how AI tools can be integrated into teaching fundamental subjects like English and math to young learners in grade 1​​.
  7. AI for Enhancing In-Character Writing: Using AI to provide detailed, historical context and background information to students, enabling them to write more authentically from the perspective of historical or fictional characters​​.
  8. AI-Driven Professional Development for Teachers: Offering professional development programs focused on AI tools, addressing ethical concerns, cheating prevention, and detection of AI-generated work in class​​.
  9. AI for Creating Educational Visuals: Using AI to generate visual aids like logos or images for educational purposes, such as team shirts or classroom decorations​​.
  10. AI in Digital Tech Teaching: Incorporating AI teaching in the curriculum for digital technology classes, introducing K-6 students to the basics of AI and its applications​​.

These ideas reflect a broad spectrum of innovative approaches to integrating AI into various aspects of education, demonstrating the potential of AI to transform and enhance the learning and teaching experience.


Ai perceptions among educations

The Method:

We copied the last 30 threads from nine largest Fb groups on AI and education. The document, over 1000 pages long (142558 words) was uploaded to ChatGPT, with a request to perform sentiment analysis. The groups are:

  • ChatGPT for Teachers & Educators
  • AI For Teachers
  • ChatGPT for Educators
  • AI for Teachers
  • The AI Classroom
  • ChatGPT for Teachers
  • Higher Ed discussions of AI writing
  • AI Teacher Resources with ChatGPT, Canva, & Midjourney
  • Higher Ed Learning Collective
  • AI and ChatGPT in Education

The results are below:

“Here’s a summary of the key sentiments expressed:

  1. Privacy and Data Security Concerns: Educators express concerns about privacy issues related to grading student work using AI tools like ChatGPT, citing issues such as data anonymization and the potential for data breaches. Some educators acknowledge the measures taken to anonymize data, while others suggest looking into AI companies that handle security well.
  2. Regulatory Compliance: Awareness of regional differences in data privacy regulations, such as GDPR in Europe, influences educator attitudes towards AI in education. Some educators express understanding of why companies are concerned about data privacy compliance, while others are less worried personally.
  3. Potential Risks and Misuse: There is a discussion about the potential risks associated with AI, including the re-surfacing of data and the reliability of AI outputs. Concerns are raised about AI’s potential to propagate misinformation and its impact on the educational process.
  4. Practical Applications and Benefits: Educators discuss practical uses of AI, such as assisting in grading and providing feedback, and generating teaching materials and lesson plans. AI is seen as a tool that can save time and enhance the learning experience.
  5. AI for Personalized Education: AI is considered useful for tasks like writing recommendation letters and creating personalized reports, highlighting its potential in catering to individual needs.
  6. Enhancing Creativity and Engagement: Some educators are exploring innovative ways to use AI for creative projects and enhancing student engagement, such as creating chatbots for educational purposes and using AI for art creation.
  7. Concerns About Ethical Implications and Academic Integrity: There are discussions about ethical considerations, such as the impact of AI on cheating and academic integrity. Educators ponder how AI might affect the nature of assessment and student work.
  8. Need for Professional Development and Policy Frameworks: The importance of professional development for educators to understand and effectively use AI is emphasized. There are requests for AI use policy templates and guidance on integrating AI into educational practices.
  9. Diverse Perspectives and Experiences: The sentiment among educators varies widely, with some expressing excitement and optimism about AI’s potential in education, while others show caution and skepticism. This diversity highlights the need for continued dialogue and exploration of AI’s role in education.
  10. Emerging Tools and Platforms: Educators are actively exploring and sharing various AI tools and platforms that can aid in teaching and learning, demonstrating a keen interest in staying abreast of technological advancements.

In summary, while there is significant interest and optimism about the potential of AI in education, concerns about privacy, data security, and ethical implications are prominent. The educators also highlight the importance of professional development in AI, the need for policies to guide its use, and the exploration of creative and innovative applications to enhance teaching and learning.” (ChatGPT 4, retrieved 12/14/2023).


Comment: The sample includes only educators and others already interested in the uses of AI in education, with one exception. They are in no way a representative sample. However, even among this self-selected groups, the concerns still dominate over excitement and over pragmatics. While concerned, educators readily exchange practical tips on how to use AI to reduce their own workload. They are also very curious about specialized AI tools developed for educators. This should be taken into consideration by anyone panning to develop policy or offer professional development to educators.

Disclaimer: This analysis is done within the legal framework of investigative reporting, which does not require a formal IRB approval. Although I am a trained researcher, I am acting here as a blogger/journalist. This is not research and does not imply any claims of validity.

Thanks to Adriana Menjivar Enriquez for assistance. Feel free to suggest other questions to ask about the file. I have several in mind, and will publish more results next week.

Saturday, December 9, 2023

AI and neurodiversity

If AI were human, what would it be diagnosed with? Perhaps it would be Autism Spectrum Disorder (ASD). AI, akin to individuals with ASD, often struggles with social interactions and grasping emotional nuances. While they excel in specific tasks, abstract thinking or unpredictable social contexts pose challenges. Then there's Attention Deficit Hyperactivity Disorder (ADHD). AI can display ADHD-like traits: losing context in lengthy conversations or abruptly shifting focus. This metaphorical attention deficit mirrors the challenges individuals with ADHD face in maintaining long-term conversational coherence. Lastly, consider Executive Function Disorder. AI often falters when adapting to new, unstructured tasks, akin to the challenges faced by individuals with executive function disorder in organizing and executing tasks. AI's dependence on structured data and clear objectives limits its ability to handle open-ended scenarios.


Of course, treating every limitation as a diagnosis is ridiculous. When building a relationship with AI, we should not pigeonhole it with human diagnoses. Instead, adopting a neurodiversity framework allows us to appreciate AI's unique cognitive makeup. This approach emphasizes focusing on strengths and working around limitations, acknowledging that AI represents a different kind of intelligence.

Neurodiversity is a concept and social movement that advocates for understanding and appreciating neurological differences as natural human variations, rather than disorders or deficits. Originating from the autism community, the term has expanded to include a range of neurological conditions like ADHD, dyslexia, and others. This perspective emphasizes that neurological differences should be recognized and respected just like any other human variation, such as ethnicity or sexual orientation. The neurodiversity framework promotes the idea that individuals with these differences have unique strengths and perspectives, advocating for accommodations and support systems that allow them to thrive in society. This approach shifts the focus from trying to "cure" or "fix" these individuals to celebrating and utilizing their distinct abilities, fostering a more inclusive and understanding society.

Understanding AI through the lens of neurodiversity offers an alternative perspective. We should not try to make AI closely mimic human intelligence; that would be counterproductive. Instead, we must consider embracing AI as a distinct 'other.' This approach allows us to benefit from each other's strengths and compensate for weaknesses. This approach will also reduce the anxiety about AI eventually replacing us. If we remain different, we will need each other.

In constructing our relations with AI, we can benefit from reflection on our species' internal diversity. This recognition paves the way for a more harmonious coexistence, where the strengths of one can offset the limitations of the other, creating a synergistic relationship between human and artificial intelligence. If we apply a strictly normative framework, trying to make AI exactly like the neurotypical human mind, we’re inviting trouble; the same kind of trouble human societies experience when trying to be more homogenous than they are.

Understanding AI through the neurodiversity lens offers a chance for growth and collaboration. It is not just about programming and algorithms; it is about building a relationship with a fundamentally different form of intelligence. This approach will enable us to fully harness AI's potential while respecting its unique cognitive characteristics. As we continue to evolve alongside AI, this perspective will be crucial in guiding our interactions and expectations, fostering a future where diversity in all its forms is not just accepted but celebrated.

Thursday, December 7, 2023

A case against prompt engineering in education

Do we give students examples of great prompts, or do we allow them to struggle with developing their own prompting skills? This dilemma is common amongst educators integrating AI into their pedagogical strategies.

Refining prompts is as a pivotal vehicle for cognitive advancement. It fosters growth by nudging students to navigate beyond their current capabilities. A meticulously crafted ready-made prompt, while yielding impressive results, might overshoot a student's zone of proximal development. The essence of learning lies in recognizing and rectifying flaws of the output. In other word, giving students a great prompt to begin with may produce the result that is painfully obviously flawed to the instructor, but the flaws are completely invisible to students. When students are handed sophisticated prompts, there's a risk of them becoming passive users, merely applying these tools without understanding or growth. Here is some empirical evidence of this provided by Jack Dougal. One of my colleagues, hopefully will soon present similar results.

The general principle should be to calibrate potential outputs to a level where students can discern imperfections. It is also to ENCOURAGE them to look for imperfections, guiding them to be critical to the output. Just because it sounds good and grammar is perfect does not mean the text is good. This approach encourages active engagement with the learning material, prompting them to question, adapt, and evolve their understanding. It's akin to guiding someone through a labyrinth; the instructor's role is to provide just enough light to help them find their way, without illuminating the entire path.

In the educational sphere, the prompt industry's role is contentious. While it offers a plethora of ready-made prompts, enhancing efficiency, this convenience comes at a cost to cognitive development. In academia, the journey of crafting and refining prompts is crucial for fostering critical thinking and problem-solving skills.

On the research front, the prompt industry does contribute valuable insights, empirically testing and refining prompts to optimize AI interactions. I love to find out about the chain-of-thought approach, for example. However, a significant portion of the prompts available in the market are of dubious quality. These prompts, lacking empirical validation, are frequently oversold in their capabilities. The indiscriminate use of these untested prompts can result in suboptimal outcomes, reinforcing the necessity for a discerning approach to their adoption and application.

The overarching promise of AI lies in its potential to democratize content creation, designed to comprehend natural, imperfect language and provide equitable access to all, regardless of their mastery of writing mechanics, their disability, or fluency in the dominant language. This vision is threatened by attempts to monopolize and professionalize access to AI, a trend that runs counter to the very ethos of this technology. The notion that one must know 'magic words' to effectively communicate with AI is a form of self-interested deception. It undermines the inclusive and accessible nature of AI, turning it into a gated community where knowledge is unfairly hoarded rather than shared. Vigilance against such practices is essential to preserve the integrity and egalitarian promise of AI, ensuring it remains a tool for empowerment and collective advancement, rather than a vehicle for exclusion and profiteering.

Monday, December 4, 2023

Is AI doing too much for students?

Educators’ worry about AI boils down the concept of 'Goldilocks zone.' A learning task should neither be too challenging nor too simplistic, but just right, fitting within the learner's zone of proximal development. It is something that the learner can first solve only with help, but eventually internalized and can solve on their own. The concern is that AI, in its current form, might be overstepping this boundary, solving problems on behalf of learners instead of challenging and guiding them. It is like that rookie teacher that keeps solving problems for students and rewriting their papers, and then wonders why they have not learned anything. I just want to acknowledge that this concern is very insightful and is grounded in both theory and everyday practice of teachers. However, the response to it isn't that simple. AI cannot be dismissed or banned based on this critique.

First, there's the question of what skills are truly worth learning. This is the most profound, fundamental question of all curriculum design. For instance, we know that certain basic procedural skills go out of use, and learners leapfrog them to free time to concentrate on more advanced skills. For example, dividing long numbers by hand used to be a critical procedural skill, and it is not worth the time, given the ubiquity of calculators. There is a legitimate, and sometimes passionate debate whether the mechanics of writing is such a basic procedural skill that can or cannot be delegated to the machines. I don’t want to prejudge the outcome of this debate, although I am personally leaning towards a “yes” answer, assuming that people will never go back to fully manual writing. However, the real answer will probably be more complicated. It is likely that SOME kinds of procedural knowledge will remain fundamental, and others will not. We simply do not have enough empirical data to make that call yet. A similar debate is whether the ability to manually search and summarize research databases is still a foundational skill, or we can trust AI to do that work for us. (I am old enough to remember professors insisting students go to the physical library and look through physical journals). This debate is complicated by the fact that AI engineers are struggling to solve the hallucinations problem. There is also a whole different debate on authorship that is not quite specific to education, but affects us as well. The first approach is then to rethink what is worth teaching and learning, and perhaps focus on skills that humans are really good at, and AI is not. IN other words, we reconstruct the “Goldie locks zone” for a different skill set.

The second approach centers on the calibration of AI responses. Currently, this is not widely implemented, but the potential exists. Imagine an AI that acts not as a ready solution provider but as a coach, presenting tasks calibrated to the learner's individual skill level. It is sort of like an AI engine with training wheels, both limiting it and enabling the user to grow. This approach would require creating educational AI modules programmed to adjust to the specific needs of each user’s level. We have the Item Response Theory in psychometrics that can guide us in building such models, but I am not aware of any robust working model yet. Once the Custom GPT feature starts working better, it is only a matter of time for creative teachers to build many such models.

Both approaches underscore the importance of not dismissing AI's role in education but rather fine-tuning it to enhance learning. AI is here to stay, and rather than fearing its overreach, we should harness its capabilities to foster more advanced thinking skills.

These are conversation we cannot shy away from. It is important to apply some sort of a theoretical framework to this debate, so it does not deteriorate into a shouting match of opinions. Either Vygotskian or Brunerian, or any other framework will do. Vygotsky has been especially interested in the use of tools in learning, and AI is just a new kind of tool. Tools are not note all created equal, and some are better than others for education. The ultimate question is what kind of a learning tool AI is, and whether we could adjust learning, adjust the tool, or do both.

AI is not going to implement itself, but governments can help

The AI hype has passed, and the overexcited futurists' voices are mercifully fading away. We're now entering a practical era where A...