Francisco R. Ortega

8933 SW 123rd. CT #204
Miami FL - 33186
http://openhid.com/

Phone: (305) 305-6391
Email: fortega@cs.fiu.edu
Alt: FranciscoRaulOrtega@gmail.com

particulars


education

Florida International University
Ph. D. in Computer Science - GPA: 3.72

Miami, FL
Fall 2014

Florida International University
M. S. in Computer Science - GPA: 3.8

Miami, FL
Fall 2008

Florida International University
B. S. in Computer Science - GPA: 3.5 - In-major GPA: 3.7

Miami, FL
Fall 2007

research interests

My research interests include Human-Computer Interaction, Gesture Elicitation, Gesture Recogni- tion, 3D User Interfaces, 3D Navigation, 3D Interaction, Multi-Modal Interaction, and Input Tech- nologies, and Virtual Environments.

Additional interests include the areas of Augmented Reality, Virtual Reality, Affective Computing, Computer Graphics, Software Design, Networking, Cyber Security, and Machine Learning.

dissertation

Title: 3D Navigation with Six Degrees-of-Freedom Using a Multi-Touch Display
Advisors: Dr. Armando Barreto and Dr. Naphtali Rishe

My dissertation provides an in-depth view of multi-touch technology used in 3D navigation. It includes a feature-extraction algorithm for multi-touch displays (FETOUCH), a multi-touch and gyroscope interaction technique (Gyro-Touch), a theoretical model for multi-touch interaction using high-level Petri Nets (PeNTa), a proposed gesture (Hold-and-Roll), and a 3D navigation user study which compares a multi-touch display and game controller in a pseudo-universe.

miscellaneous

Nationalities: U.S. Citizen, Chilean Citizen.

Ethnicity: Hispanic.

academic honors


work experience


research experience


grants


awarded

not funded

teaching experience


florida international experience

mentoring experience


directed research - Current students

directed research - Former students

general

publications


Refereed Journals

  1. Ortega, F., Tarre, K., Rishe, N., and Barreto, A., “3D Navigation for 6DOF Using Multi-Touch vs. GamePad”, under submission in International Journal of HumanComputer Studies, 2017.

  2. Cofino J., Barreto A., Abyarjoo F., and Ortega, F., “Sonically-Enhanced Tabular Screen-Reading”, Journal on Technology & Persons with Disabilities (JTPD), Vol. 2, pp. 46–57, 2014.

  3. Ren P., Barreto A., Huang J., Gao Y., Ortega, F., and Adjouadi, M., “Off-line and On-line Stress Detection through Processing of the Pupil Diameter Signal.” In Annals of Biomedical Engineering, vol. 42, no. 1, pp. 162–176, 2014.

Refereed Conferences

  1. Balcazar, R., Ortega, F., Tarre, K., Barreto, A., Weiss, M., Rishe, N., “CircGR : Real-Time Multi-Touch Circular Gesture Recognition”, to appear in Proceedings of the 2017 ACM on Interactive Surfaces and Spaces (ISS ’17). Brighton, England.

  2. Ortega, F., Galvan, A., Tarre, K., Barreto, A., Rishe, N., Bernal, J., Balcazar, R., and Thomas, J., “Gesture Elicitation for 3D Travel via Multi-Touch and Mid-Air Systems for Procedurally Generated Pseudo-Universe.” In 2017 IEEE Symposium on 3D User Interfaces (3DUI), Los Angeles, CA, 2017, pp 144–153.

  3. Tangnimitchok, S., O-Larnnithipong, N., Barreto, A.,Ortega, F. R., and Rishe, N. D., “Finding an Efficient Threshold for Fixation Detection in Eye Gaze Tracking.” In International Conference on Human-Computer Interaction, Interaction Platforms and Techniques of the series Lecture Notes in Computer Science- Volume 9732, pp. 93-103, Springer-Verlag New York, Inc., Jul. 2016.

  4. Abyarjoo, F., O-Larnnithipong, N., Tangnimitchok, S., Adjouadi, M., Ortega, F., and Barreto, A., “PostureMonitor: Real-Time IMU Wearable Technology to Foster Poise and Health.” In International Conference of Design, User Experience, and Usability of the series Lecture Notes in Computer Science, vol. 9188, Springer International Publishing, pp 543–552, Aug. 2015.

  5. Ortega, F., Barreto, A., Rishe, N., Adjouadi, M., Abyarjoo, F., and O-Larnnithipong, N., “GyroTouch: Wrist Gyroscope with a Multi-Touch Display.” In International Conference on Human-Computer Interaction, Human-Computer Interaction: Interaction Technologies of the series Lecture Notes in Computer Science, vol. 9170, pp. 262–270, Springer International Publishing, Aug. 2015.

  6. Ortega, F., Barreto, A., Rishe, N., Adjouadi, M., and Abyarjoo, F., “Multi-Touch Gesture Recognition Using Feature Extraction.” In Innovations and Advances in Computing, Informatics, Systems Sciences, Networking and Engineering of the series Lecture Notes in Electrical Engineering, vol. 313, pp. 291–296, Springer International Publishing, 2015.

  7. Abyarjoo, F., Barreto, A., Cofino, J., and Ortega, F., “Implementing a Sensor Fusion Algorithm for 3D Orientation Detection with Inertial/Magnetic Sensors.” In Innovations and Advances in Computing, Informatics, Systems Sciences, Networking and Engineering of the series Lecture Notes in Electrical Engineering, vol. 313, pp. 305–310, Springer International Publishing, 2015.

  8. Ortega, F., Liu, S., Hernandez, F., Barreto, A., Rishe, N., and Adjouadi, M., “PeNTa: Multi-Touch Modeling using Petri Nets.” In International Conference on Human-Computer Interaction, Human-Computer Interaction: Theories, Methods, and Tools of the series Lecture Notes in Computer Science, HCI International 2014), vol 8510, pages 361–372. Springer International Publishing, June 2014.

  9. Cofino, J., Barreto, A., Abyarjoo, F., and Ortega, F., “Sonifying HTML Tables for Audio-Spatially Enhanced Non-Visual Navigation.” In IEEE SoutheastCon, 2013 Proceedings of IEEE, Jacksonville, FL, pp. 1–5, 2013.

  10. Abyarjoo, F., Barreto, A., Abyarjoo, S., Ortega, F., and Cofino, J., “Monitoring Human Wrist Rotation in Three Degrees of Freedom.” In IEEE SoutheastCon, 2013 Proceedings of IEEE, Jacksonville, FL, pp. 1–5, 2013

  11. Ortega, F., Barreto, A., Rishe, N., and Adjouadi, M., “Interaction with 3D Environments Using Multi-Touch Screens.” In Innovations and Advances in Computer, Information, Systems Sciences, and Engineering of the series Lecture Notes in Electrical Engineering, vol. 152, pp. 381–392, CISSE. Springer, New York, 2013.

  12. Wu, Y., Hernandez, F., Ortega, F., Clarke, P., and France, R., “Measuring the Effort for Creating and Using Domain-Specific Models.” In Proceedings of the 10th Workshop on Domain-Specific Modeling (DSM ’10). ACM, New York, NY, USA, article 14, pages 6, 2010.

  13. Verhoef, T., Lisetti, C., Barreto, A., Ortega, F., Van der Zant, T., and Cnossen, F., “Bio-sensing for Emotional Characterization without Word Labels.” In Human-Computer Interaction. Ambient, Ubiquitous and Intelligent Interaction, 13th International Conference, HCI International. LNCS 5612, pp. 693–702, 2009.

Workshop and Poster Refereed Papers

  1. Ortega, F., Jamides, S., Barreto, A., and Rishe, N., “The Tabletop is dead. Long Live the Tabletop!”, to appear in The Disappearing Tabletop: Social and Technical Challenges for Cross-Surface Collaboration workshop on Interactive Surfaces and Spaces (ISS ’17).

  2. Ortega, F., Bolivar, S., Bernal, J., Galvan, A., Tarre, K., Rishe, N., and Barreto, A., “Towards a 3D Virtual Programming Language to Increase the Number of Women in Computer Science Education.” In 2017 IEEE Virtual Reality Workshop on K-12 Embodied Learning through Virtual & Augmented Reality (KELVAR), Los Angeles, CA. pp. 1–6.

  3. Galvan, A., Ortega, F., and Rishe, N., “Procedural Celestial Rendering for 3D Navigation.” In 2017 IEEE Symposium on 3D User Interfaces (3DUI), Los Angeles, CA. 2017. pp. 211–212

  4. Calella, J., Ortega, F., Rishe, N., Barreto, A., and Bernal, J., “HandMagic: Towards User Interaction with Inertial Measuring Units.” In 2016 IEEE SENSORS. Orlando, FL. 2016, pp. 1-3.

  5. Ortega, F., Balcazar, R., Barreto, A., and Rishe, N., “Smart Learning Desk: Towards an Interactive Classroom.” In IEEE Virtual Reality 2016 Workshop on K-12 Embodied Learning through Virtual & Augmented Reality (KELVAR ’16), Mar. 2016. Available at: https://sites.google.com/site/vrkelvar/vr2016

  6. Vassigh, S., Elias, A., Ortega, F., Davis, D., Gallardo, G., Alhaffar, H., Borges, L., Bernal, J., and Rishe, N., “Integrating Building Information Modeling with Augmented Reality for Interdisciplinary Learning.” In Mixed and Augmented Reality (ISMAR-Adjunct), 2016 IEEE International Symposium on, pp. 260–261, IEEE, 2016.

  7. Ortega, F., Rishe, N., and Barreto, A., “TAMGeF: Touch-midAir-Motion Framework for Spatial Input.” In Proceedings of the 3rd ACM Symposium on Spatial User Interaction (SUI ’15). ACM, New York, NY, USA, pp. 136, 2015.

  8. Ortega, F., Barreto, A., Rishe, N., Adjouadi, M., and Liu, S., “Exploring Modeling Language for Multi-Touch Systems Using Petri Nets.” In Proceedings of the 2013 ACM International Conference on Interactive Tabletops and Surfaces (ITS ’13), ACM, New York, NY, USA. pp. 361–364. 2013.

  9. Ortega, F., Barreto, A., and Rishe, N., “Augmenting Multi-Touch with Commodity Devices.” In Proceedings of the 1st Symposium on Spatial User Interaction (SUI 13). ACM, New York, NY, USA, p. 95. 2013.

  10. Ortega, F., Barreto, A., Rishe, N. and Adjouadi, M., and Abyarjoo, F., “Poster: Real-Time Gesture Detection for Multi-Touch Devices.” In IEEE 8th Symposium on 3D User Interfaces, pp. 167-168. 2013.

  11. Hernandez, H., Ortega, F., “Eberos GML2D: A Graphical Domain-Specific Language for Modeling 2D Video Games.” In Proceedings of the 10th Workshop on Domain-Specific Modeling (DSM ’10). ACM, New York, NY, USA, article 4, pages 6, 2010.

Other Referred Papers

  1. Aazhang, B., Abler, R. T., Allebach, J. P., Bost, L. F., Cavallaro, J. R., Chong, E. K. P., Coyle, E. J., Cullers, J. B. S., Dennis, S. M., Dong, Y., Enjeti, P. N., Filippas, A. V., Froyd, J. E., Garmire, D., George, J., Gilchrist, B. E., Hohner, G. S., Hughes, W. L., Johnson, A., Kim, C., Kim, H., Klenke, R. H., Lagoudas, M. Z., Llewellyn, D. C., Lu, Y., Lybarger, K. J., Marshall, S., Muralidharan, S., Ohta, A. T., Ortega, F. R., Riskin, E. A., Rizzo, D. M., Ryder, C. R., Shiroma, W. A., Siller, T. J., Sonnenberg-Klein, J., Sadjadi, S. M., Strachan, S. M., Taheri, M., Woods, G. L., Zoltowski, C. B., Fabien, B. C., Johnson, P., Collins, R., and Murray, P. “Vertically Integrated Projects (VIP) Programs: Multidisciplinary Projects with Homes in Any Discipline” In 2017 ASEE Annual Conference & Exposition, Columbus, Ohio. June, 2017. https://peer.asee.org/29103

Books

  1. Ortega, F., Rishe, N., and Barreto, A., 3D Multimodal interaction: With an Input Perspective, CRC Press/AK Peters book. New York, NY. 2018.

  2. Ortega, F., Rishe, N., and Barreto, A., Multi-Touch: Gesture Recognition, Elicitation, and More, CRC Press/AK Peters book. New York, NY. 2018.

  3. Ortega, F. Abyarjoo, F., Barreto, A., Rishe, N., and Adjouadi, M., Interaction design for 3D user interfaces: the world of modern input devices for research, applications, and game development. CRC Press/AK Peters, New York, NY, 2016.

Book Chapters

  1. Hernandez, H., Ortega, F., “Reducing Video Game Creation Effort with Eberos GML2D.” Chapter in Game Development Tools Books edited by Marwan Y. Ansari. AK Peters/CRC Press. New York, NY, 2011.

Non-refereed Papers

  1. Ortega, F., Barreto, A., Rishe, N., and Adjouadi, M., “Towards 3D Data Environments Using Multi-Touch Screens.” In ACHI 2012: The Fifth International Conference on Advances in Computer-Human Interactions, pp. 118–121, 2012.

  2. Ortega, F., Barreto, A., Rishe, N., Adjoudi, M., and Abyarjoo, F., “GyroTouch: Complementing the Multi-Touch Display.” In ACM Richard Tapia Celebration of Diversity in Computing, 2014.

  3. Cofino, J., Barreto, A., Abyarjoo, F., and Ortega, F., “B.A.S.S. Blind-Assistive Spatialized Screen-reading.” In ACM Richard Tapia Celebration of Diversity in Computing, 2014

patents & applications


  1. Barreto, A., O-Larnnithipong, N., Ortega, F., and Rishe, N., “Roundtable VRT.” Disclosed to FIU, January, 2017. Current Status: Approved by FIU for application submission.

  2. Ortega, F., Rishe, N., and Barreto, A., “MagicMotion.” Disclosed to FIU, May, 2016. Current Status: Approved by FIU for application submission.

  3. Ortega, F., Rishe, N., and Barreto, A., “Gesture Discernment and Processing System.” US Utility Patent filed November 28th, 2014, USPS Application Number 20160091977, publication date March 31st, 2016, pending.

talks


  1. Ortega, F., “Smart Learning Desk: Towards an Interactive Classroom.” In IEEE Virtual Reality 2016 Workshop on K-12 Embodied Learning through Virtual & Augmented Reality, Greenville, SC, March 19, 2016.

  2. Ortega, F., “PostureMonitor: Real-Time IMU Wearable Technology to Foster Poise and Health.” In HCI International 2015. Los Angeles, CA, August 2015.

  3. Ortega, F., “TAMGeF: Touch-midAir-Motion Framework for Spatial Input.” In ACM Symposium on Spatial User Interaction, (fast forward). Los Angeles, CA, August 2015.

  4. Ortega, F., “GyroTouch: Wrist Gyroscope with a Multi-Touch Display.” In HCI International 2015, Los Angeles, CA, August 2015.

  5. Ortega, F., “Towards 3D navigation Using Multi-Touch Displays.” In University of Florida (Computer Science). Invited by Dr. Lisa Anthony. Gainesville, FL, 2015.

  6. Ortega, F., “PeNTa: Formal Modeling for Multi-Touch Systems Using Petri Nets.” In HCI International 2014. Crete, Greece, June 2014.

  7. Ortega, F., “Towards 3D Navigation using Multi-Touch.” In McKnight Yearly Fellowship Meeting, Tampa, FL, 2014.

  8. Ortega, F., “Feature Extraction for Multi-Touch.” In McKnight Fellowship at FIU, Miami, FL, January 23rd, 2014.

  9. Ortega, F., “3D Navigation with Commodity Devices and the Formalization of Multi-Touch Lan- guage.” In University of Leeds, Colloquium Friday Series. Invited by Dr. Roy Ruddle. Leeds, England, October 18, 2013.

  10. Ortega, F., Poster Presentation. “Exploring Modeling Language for Multi-Touch Systems Using Petri Nets.” In ACM Interactive Tabletop and Surfaces (ITS ’13), St. Andrew, Scotland. 2013.

  11. Ortega, F., Poster Presentation and Fast-Forward, “Augmenting Multi-Touch with Commodity De- vices.” In CM Symposium on Spatial User Interaction (SUI ’13), Los Angeles, CA, 2013

  12. Ortega, F., “Looking Ahead: A Case for 3D User Interfaces.” Guest Speaker for Florida International University, Software Engineering Course, Miami, FL, Mar. 27th, 2012.

  13. Ortega, F., Poster Presentation and Fast Forward, “Poster: Real-Time Gesture Detection for Multi-Touch Devices.” In IEEE 8th Symposium on 3D User Interfaces (3DUI ’13), Orlando, FL, Mar. 16th, 2013.

  14. Ortega, F., “Natural User Interfaces in 3D Navigation.” Guest Speaker Florida International University for Computer Graphics, Miami, FL., Feb. 26th, 2012.

  15. Ortega, F., “Motivating Young Minds: Computer Science and Human-Computer Interaction.” Guest for Career Day at W.R Thomas Middle School, Miami, FL, 13001 SW 26 STREET MIAMI, FL 33175, May 2nd, 2012.

  16. Ortega, F., “3D Navigation via 2D Multi Touch Surfaces.” In FIU CS PhD Student Seminars, Miami, FL, Apr. 12th, 2012.

professional activities


service


languages


Proficient in English and Spanish.

references


PDF version: http://openhid.com/fortega/cv.pdf