MBZUAI is hosting a short course on developing open-source machine learning packages. The course will be led by Chih-Jen Lin, an affiliated professor at MBZUAI and distinguished professor at National Taiwan University, who has developed widely used ML packages like LIBSVM and LibMultiLabel. The course will cover topics such as starting a project, choosing functionalities, and identifying research problems from user feedback. Why it matters: This course can help improve the quality and usability of open-source machine learning tools coming from the region's research institutions.
The article discusses the challenges in effectively applying text classification techniques, despite the availability of tools like LibMultiLabel. It highlights the importance of guiding users to appropriately use machine learning methods due to considerations in practical applications such as evaluation criteria and data strategies. The piece also mentions a panel discussion hosted by MBZUAI in collaboration with the Manara Center for Coexistence and Dialogue. Why it matters: This signals ongoing efforts within the UAE AI ecosystem to address practical challenges and promote responsible AI usage in NLP applications.
The paper introduces a novel method for short-term, high-resolution traffic prediction, modeling it as a matrix completion problem solved via block-coordinate descent. An ensemble learning approach is used to capture periodic patterns and reduce training error. The method is validated using both simulated and real-world traffic data from Abu Dhabi, demonstrating superior performance compared to other algorithms.
A KAUST-led team in collaboration with Japan's National Institute of Informatics and Cray Inc. has implemented a new algorithm to harness the power of supercomputers. The algorithm integrates new singular value decomposition (SVD) codes into Cray LibSci scientific libraries, supporting machine learning and data de-noising applications. This was achieved through the Cray Center of Excellence (CCOE) at KAUST, established in 2015. Why it matters: The new algorithm helps to optimize the use of advanced supercomputing infrastructure in the region, specifically KAUST's Shaheen II, for computationally intensive AI applications.
Xiaolin Huang from Shanghai Jiao Tong University presented a talk at MBZUAI on training deep neural networks in tiny subspaces. The talk covered the low-dimension hypothesis in neural networks and methods to find subspaces for efficient training. It suggests that training in smaller subspaces can improve training efficiency, generalization, and robustness. Why it matters: Investigating efficient training methods is crucial for resource-constrained environments and can enable broader access to advanced AI.
Qirong Ho, co-founder and CTO of Petuum Inc., will be contributing to the "ML Systems for Many" initiative. Petuum is recognized for creating standardized building blocks for AI assembly. Ho also holds a Ph.D. from Carnegie Mellon University and is part of the CASL open-source consortium. Why it matters: Showcases the ongoing efforts to democratize AI development and deployment, making it more accessible and sustainable, although the specific initiative is not further detailed.
Researchers developed a data-driven toolkit for short-term traffic forecasting using high-resolution traffic data from urban road sensors. The method models forecasting as a matrix completion problem, mapping inputs to a higher-dimensional space using kernels and adaptive boosting. Validated using real-world data from Abu Dhabi, UAE, the method outperforms state-of-the-art algorithms.
MBZUAI and KAUST researchers collaborated to present new optimization methods at ICML 2024 for composite and distributed machine learning settings. The study addresses challenges in training large models due to data size and computational power. Their work focuses on minimizing the "loss function" by adjusting internal trainable parameters, using techniques like gradient clipping. Why it matters: This research contributes to the ongoing advancement of machine learning optimization, crucial for improving the performance and efficiency of AI models in the region and globally.