ChenF
Fang Chen
Research Leader
Previous Positions
Dr. Fang Chen was employed with Beijing Jiaotong University in China from 1995-1999. She was appointed Associate Professor of the Faculty of Electronic and Information Engineering in 1995, the Deputy Director of the Institute of Information Science in 1996 and then Dean of Faculty of Electronic and Information Engineering in 1997.
Dr. Chen began her career in industry in 1999 as senior researcher and Team Leader in Intel China Research Centre. She joined Motorola in 2000 as Principal Researcher and founding manager of the Speech and Language Generation Research Lab of Motorola China Research Centre, where she also acted as the account manager of business relationships for the Motorola China Research Centre.
Dr. Chen moved to Australia in 2002 to work for the Motorola Australian Research Centre, where she chaired the Patent and Publication Committees.
She joined NICTA in 2004 and is currently the Research Leader at the ATP Laboratory in Machine Learning Research Group.
Qualifications
Dr. Chen holds PhD in Communications and Electronic Systems and an MBA.
Research Interests
NICTA Past Projects
Dr. Chen was the Research Group Manager for the Making Sense of Data (MSD) research theme at the ATP Laboratory. Projects under this theme:
- The Decision Support for Incident Management (DSIM) project aims to research and develop core technologies for a new generation of human computer interfaces that support critical decision-making for users in high-performance and time critical environments. The research focuses on i) measuring the cognitive load experienced by human operators of large volume and complex information systems, in real-time and in an unobtrusive way; ii) optimising joint human-system integration via adaptive decision support based on human cognitive status and situational context.
- Human Performance Improvement (HPI). When elite athletes become fatigued their competitive edge may be lost. In Emergency Services and Defence, fatigue may be fatal. Monitoring human performance is critical to ensure safety and peak competitive output. Coaches and commanders need to monitor personnel in training and in the field, and to have instant feedback on performance. At present, athletes and soldiers are monitored under special laboratory conditions, have data returned to base after several days of logging, and may fill out surveys to determine their own performance. Coaches and commanders want real-time feedback of performance: the challenge is to interpret, transmit and display the information. There are two work packages from HPI is under MSD theme at ATP lab.
- The STaR-UI project proposes to introduce multimodal input technologies and the fusion of these inputs and cognitive load based multimodal output generation to address the need of control rooms. The project is developing technologies that efficiently guide control room operators through processes such as incident response, to automatically generate reports and present other relevant information to the operators as they proceed. The project is also developing and implementing cognitive load management techniques to streamline interaction with various traffic management centre applications enabling more effective application integration and more reliable traffic management operations.
- The Braccetto project is a collaborative project in human-machine interaction. It aims to develop sophisticated information sharing technology that can help geographically distributed teams collaborate more effectively. The project is developing new methods for supporting simultaneous work on software applications between sites in conjunction with tightly linked, high-quality, multi-party telepresence technology. The project will evaluate how these methods improve the productivity of teams and team members’ awareness of co-workers.
- The DMiST project combines the areas of computational geometry, data mining, data bases and algorithm design. The movement of objects (e.g. cars, people, animals) can be represented by trajectories in the plane. Analysing these provides and trying to find interesting patterns such as where animals meet to form a flock is the aim of the project.
Affiliations
Dr. Chen has received Conjoint Professor and Honorary Associate positions with the University of New South Wales and the University of Sydney. She is also an adjunct professor in Beijing Jiaotong University.
Selected Patents
- Text-to-Speech System with Prosodic Control, China patent application No. ZL02127007.4 Huang, J., Chen, F, 25 July 2002. Granted 14 June 2006. Patent number : 02127007.4
- Method For Chinese Word Segmentation, China patent application No. ZL02127005.8 Chen, G., Chen, F, 25 July 2002, granted 17 May, 2006. Patent number : 02127005.8
- Method for Synthesizing Speech, China patent application No. 03132698.6, Chen, F., Chen, G., 29 September 2003. Granted 14 June 2006. Patent number: 03132698.6
- Method for Synthesizing Speech, South Korea patent application, Chen, F., Chen, G., 17 September 2004. Granted 16 Oct, 2007. Patent Number: 769033
- Measuring Cognitive Load (Speech Content Analysis), Australian patent application AU2008905089, Sept 30, 2008., Fang CHEN; Muhammad Asif KHAWAJA, Eric CHOI
- Measuring Cognitive Load (Multimodal), Canada patent application CA2655189, Dec 12, 2008., Chen, F., Choi, E., Ruiz., N.
- Measuring Cognitive Load, US patent application WO2007000030, Jan 4, 2007, Chen, F., Choi, E., Ruiz., N.
- Multimodal Computer Navigation, US patent application WO2006128248, Dec 7, 2006, Taib, R., Chen, F., Shi, Y.
- Measuring Cognitive Load, Australia patent application AU2006264222, Jun 28, 2006; AU2005903441, Jun 29, 2005. Chen, F., Choi, E., Ruiz., N.
- Active Speech Cancellation, China patent application No. 03122115.7, Zhang, Y., Huang, J., Chen, F., 18 April 2003
- Text Summarisation, PCT application No. PCT/US04/36896, Chen, F., Han, K., 4 November 2004.
- Method for Synthesizing Speech, PCT application No. PCT/US04/30467, Chen, F., Chen, G., 17 September 2004
- Text-to-Speech System with Prosodic Control, Japan patent application No. 2004-524006, Huang, J., Chen, F., 24 January 2005
- A method for extracting user preference and its application in search based on metadata annotation, US patent application No. 11/123351, Chen, F., Li, W. June 2005
- Method for Synthesizing Speech, Korea patent application No. 10-2005-7001367, Chen, F, Oct., 2005
Selected Publications
1. Chen, F., Ruiz, N., Choi, E., Epps, J., Khawaja, A., Taib, R., Yin, B. and Wang, Y., “Multimodal Behaviour and Interaction as Indicators of Cognitive Load”, ACM Transactions on Interactive Intelligent Systems, 2012.
2. Khawaja, M. A., Chen, F., Marcus, N., “Analysis of Collaborative Communication for Linguistic Cues of Cognitive Load”, International Journal of Human Factors and Ergonomic Society, 2011.
3. Yin, B., Ambikairajah, E. and Chen, F., “Language-dependent Contribution Measuring and Weighting for Combining Likelihood Scores in Language Identification Systems”, Journal of Signal Processing Systems, Springer, vol. 59, no. 2, May 2010, pp. 201-210.
4. Ruiz
5. Yin, B., Ambikairajah, E. and Chen, F., “Language-dependent Contribution Measuring and Weighting for Combining Likelihood Scores in Language Identification Systems”, Journal of Signal Processing Systems, Springer, vol. 59, no. 2, May 2010, pp. 201-210.
6. Yin, B., Ambikairajah, E. and Chen, F., “Language-dependent Contribution Measuring and Weighting for Combining Likelihood Scores in Language Identification Systems”, Journal of Signal Processing Systems, Springer, online publication, December 2008.
7. Choi, E., Taib, R., Shi, Y. and Chen, F., “Multimodal User Interface for Traffic Incident Management in Control Room”, IET Intelligent Transport Systems, vol. 1, no.1, Mar 2007, pp. 27-36.
8. Yin, B. and Chen, F., “Towards Automatic Cognitive Load Measurement from Speech Analysis”, in Human-Computer Interaction: HCI Intelligent Multimodal Interaction Environments, Jacko, Julie A. (Ed.), Springer-Verlag Berlin Heidelberg 2007, pp. 1011-1020.
9. Xu, J., Wang, Y., Chen, F. and Choi, E., “Pupillary Response Based Cognitive Workload Measurement under Luminance Changes”, Proc. IFIP International Conference on Human-Computer Interaction (INTERACT’11), Lisbon, Portugal, September 2011, pp. 178-185.
10. Knoll, A., Wang, Y., Chen, F., Xu, J., Ruiz, N., Epps, J. and Zarjam, P., “Measuring Cognitive Workload with Low-Cost Electroencephalograph,” Proc. IFIP International Conference on Human-Computer Interaction (INTERACT’11), Lisbon, Portugal, September 2011, pp. 568-571.
11. Zarjam, P., Epps, J. and Chen, F., “Characterizing Working Memory Load Using EEG Delta Activity”, Proc. 19th European Signal Processing Conference (EUSIPCO’11), Barcelona, Spain, August 2011, pp. 1554-1558.
12. Xu, J., Wang, Y., Chen, F., Choi, E., Li, G., Chen, S. and Hussain, S., “Pupillary Response Based Cognitive Workload Index under Luminance and Emotional Changes”, Proc. SIGCHI Conference on Human Factors in Computing Systems (CHI’11), Vancouver, Canada, May 2011, pp. 1627-1632.
13. Chen, S.
14.
15. Khawaja, M. A., Chen, F. and Marcus, N., “Using Language Complexity to Measure Cognitive Load for Adaptive Interaction Design”, Proc. International Conference on Intelligent User Interfaces (IUI’10), Hong Kong, China, February 2010, pp. 333-336.
16. Khawaja, M. A., Chen, F., Owen, C., Hickey, G., “Cognitive Load Measurement from User’s Linguistic Speech Features for Adaptive Interaction Design”, International Conference on Human-Computer Interaction (INTERACT’09), Uppsala, Sweden, August 2009, pp. 485-489.
17. Sun Y., Shi, Y., Chen, F. and Chung V., “Skipping Spare Information in Multimodal Inputs during Multimodal Input Fusion”, Proc. International Conference on Intelligent User Interfaces (IUI'09), Sanibel Island, USA, February 2009, pp. 451-455.
18. Ruiz, N., Chen, F.,Farrow, D., Bruce, L., Speech-Based Cognitive Load Assessment of Athletes, 7th International Symposium on Computer Science in Sport, Australia, September, 2009.
19. Sun, Y., Prendinger. H., Shi, Y., Chen, F., Chung, V. and Ishizuka, M., “THE HINGE between Input and Output: Understanding the Multimodal Input Fusion Results In an Agent-Based Multimodal Presentation System”, Proc. SIGCHI Conference on Human Factors in Computing Systems (CHI’08), Florence, Italy, Apr. 2008, pp. 3483-3488.
20. Yap, T. F., Ambikairajah, E., Choi, E. and Chen, F., “Phase Based Features for Cognitive Load Measurement System”, Proc. IEEE International Conference on Acoustic, Speech and Signal Processing (ICASSP’09), Taipei, Taiwan, April 2009, pp. 4825-4828.
21. Yin, B., Chen, F., Ruiz, N. and Ambikairajah, E., “Exploring Classification Techniques in Speech based Cognitive Load Monitoring”, Proc. InterSpeech 2008, Brisbane, Australia, September 2008, pp2478-2481.
22. Yin, B., Chen, F., Ruiz, N. and Ambikairajah, E., “Speech-based Cognitive Load Monitoring System”, Proc. IEEE International Conference on Acoustic, Speech and Signal Processing (ICASSP’08), Las Vegas, March/April 2008, pp. 2041-2044.
23. Yin, B., Ruiz, N., Chen, F. and Khawaja, M. A., “Automatic Cognitive Load Detection from Speech Features”, Proc. Australasian Computer-Human Interaction Conference 2007 (OzCHI’07), Adelaide, Nov. 2007, pp. 249-255. Best Paper Award
24. Yin, B. and Chen, F., “Towards Automatic Cognitive Load Measurement from Speech Analysis”, Proc.12th International Conference on Human-Computer Interaction (HCII’07), Beijing, July 2007, pp. 1011-1020.
25. Shi, Y., Ruiz, N., Taib, R., Choi, E. and Chen, F., “Galvanic Skin Response (GSR) as an Index of Cognitive Load”, Proc. SIGCHI Conference on Human Factors in Computing Systems (CHI’07), San Jose, April/May 2007, pp. 2651-2656.
Email: fang.chen@nicta.com.au
