Do You See What I See: Exploration of Using AI and AR | MathWorks
About This Video
Welcome to the world of artificial intelligence (AI) and augmented reality (AR)! This workshop explains AI and AR via hands on exercises where you will interact with your augmented world. You will learn about applications where the technologies of AI+AR are combined, their limitations, and their impacts in society. You’ll leave armed with code, inspiration, and an ethical framework for your own projects!
Artificial intelligence (AI) is used in a variety of industries for many applications. AI can be combined with other technologies to assist with understanding implications of certain aspects of applications. In this workshop, you explore how pose estimation results implemented using Deep Learning are impacted based on a location which is provided using augmented reality. These combined technologies provide insight into how poses could be interpreted differently based on a scene. This workshop also raises awareness regarding consequences of using AI for applications that are different from its originally intended use, which could lead to both technical and ethical challenges.
Specific topics that will be covered in this workshop are listed below:
• understand how AI and AR can be used for applications
• explore how to implement AI and AR
• discover what tools can be used to implement AI and AR
• review code that implements pose estimation using AI and changing background scenes using AR
• gain guidance regarding challenges to address societal impacts of the results from applications that use AI and AR
In addition to receiving an overview of terminology and an understanding of the workflows for each topic, code will be provided to demonstrate how to implement these workflows with tools from MathWorks.
This workshop was conducted by Louvere Walker-Hannon, Shruti Karulkar, & Sarah Mohamed from MathWorks.
In This Video
Application Engineering Senior Team Lead, MathWorks
Louvere Walker-Hannon is a MathWorks Senior Application Engineer, who provides direction and recommendations on technical workflows for various applications. She has a bachelor’s degree in Biomedical Engineering and a master’s degree in Geographic Information Technology with a specialization in Remote Sensing.
Senior Software Engineer, MathWorks
Sarah Mohamed is a Software Engineer at MathWorks working on deep learning interoperability. She develops tools that allow AI models to be exchanged and deployed among frameworks such as MATLAB, Pytorch, TensorFlow, and ONNX. In the past, she has also worked as an Application Support Engineer, where she interacted directly with customers developing deep learning applications. She obtained her M.Sc. in Computational Science and Engineering from Harvard University, and holds dual bachelor’s degrees in Computer Science and Biology from the University of Virginia. She has experience organizing and delivering hands-on workshops at the Grace Hopper Celebration, the world’s largest conference for women in computing, as well as TechTogether Boston, the largest student-led hackathon for women and nonbinary individuals in Boston.
Quality Engineering Manager, MathWorks
Shruti Karulkar is the Quality Engineering Manager MATLAB Hardware at MathWorks. Shruti’s team of highly creative engineers work to design and implement cutting-edge tools to qualify MATLAB and Simulink support for hardware ranging from simple – Arduino/Raspberry Pi/iOS and Android phones – to high-end RF Signal Generators. Shruti has a long history of serving as a STEM mentor and is a STEM Ambassador for MathWorks. Shruti was a Speaker at GHC18, GHC19 and GHC20 delivering successful and popular hands-on AI workshops.