International Journal of Machine Learning and Predictive Analytics
type: channel
language: en
publication name: International Journal of Machine Learning and Predictive Analytics
issn: 3142-788X
items: Agent-Based Machine Learning Frameworks for Autonomous Predictive Decision Systems
items: Federated Continual Learning for Privacy-Preserving Predictive Intelligence
items: Physics-Informed Machine Learning Models for Reliable Time-Series Forecasting
items: Causal Machine Learning Frameworks for Robust Predictive Modeling in Dynamic Environments
items: Hybrid Knowledge Graph and Large Language Model Architectures for Predictive Analytics
items: Large Language Model-Augmented Machine Learning Pipelines for Automated Predictive Intelligence
items: Foundation Model Distillation Techniques for Resource-Efficient Predictive Analytics
items: Uncertainty-Aware Machine Learning Models for Trustworthy Predictive Decision Support Systems
items: Federated Predictive Learning with Privacy-Aware Model Aggregation for Distributed Analytics
items: Continual Learning Frameworks for Adaptive Predictive Analytics in Non-Stationary Data Streams
items: Foundation Model-Based Predictive Analytics for Multi-Domain Decision Intelligence
items: Hybrid Statistical–Machine Learning Approaches for Predictive Analysis
items: Knowledge-Based Machine Learning Models for Decision Support Systems
items: Automated Predictive Model Selection Using Meta-Learning Techniques
items: Machine Learning Frameworks for Large-Scale Data Forecasting
items: Intelligent Model Calibration for Improved Prediction Accuracy
items: AI-Driven Data Sampling Strategies for Efficient Model Training
items: AI-Based Predictive Analytics Frameworks for Data-Driven Organizations
items: Machine Learning Approaches for Adaptive Forecasting Systems
items: Predictive Modeling Techniques for Complex Multivariate Data
items: Sparse Machine Learning Models for High-Dimensional Data Analysis
items: AI-Based Automated Feature Selection for Predictive Modeling
items: AI-Based Model Evaluation Techniques for Reliable Predictions
items: Hybrid Machine Learning Models for Complex Pattern Detection
items: Machine Learning-Based Data Sampling Techniques for Big Data Analytics
items: Interpretable Machine Learning Models for Critical Decision Systems
items: Ensemble Learning Techniques for Enhanced Classification Accuracy
items: Semi-Supervised Learning for Data-Scarce Environments
items: A Comparative Study of Supervised Learning Algorithms for High-Dimensional Data
items: Improved Gradient Descent Optimization Using Adaptive Step-Sizing

Agent-Based Machine Learning Frameworks for Autonomous Predictive Decision Systems
type: item
description: Artificial Intelligence (AI), Machine Learning (ML), and autonomous intelligent systems are transforming predictive decision-making across industries such as manufacturing, healthcare, finance, transportation, cybersecurity, and smart cities. Traditional centralized machine learning models often struggle to adapt to dynamic and uncertain environments. This paper proposes an Agent-Based Machine Learning Framework for Autonomous Predictive Decision Systems (ABML-APDS) that integrates distributed intelligent agents, collaborative learning, reinforcement learning, predictive analytics, and explainable AI into a unified architecture. The framework enables autonomous agents to collect data, engineer features, exchange knowledge, optimize predictions, and continuously improve decision-making with minimal human intervention. It incorporates explainable decision mechanisms to enhance transparency, trust, and interpretability while supporting supervised, unsupervised, deep, and reinforcement learning models. Continuous learning and decentralized agent collaboration improve adaptability, scalability, fault tolerance, computational efficiency, and real-time responsiveness. The proposed framework provides an intelligent and scalable foundation for next-generation autonomous predictive systems supporting Industry 5.0, cyber-physical systems, IoT, smart manufacturing, precision healthcare, and AI-driven digital transformation.
subject: Articles
  topic: section
subject: Agent-Based Machine Learning
  topic: keywords
subject: Autonomous Decision Systems
  topic: keywords
subject: Predictive Analytics
  topic: keywords
subject: Multi-Agent Systems
  topic: keywords
subject: Artificial Intelligence
  topic: keywords
subject: Reinforcement Learning
  topic: keywords
subject: Distributed Intelligence
  topic: keywords
subject: Explainable AI
  topic: keywords
subject: Autonomous Computing
  topic: keywords
subject: Intelligent Decision Support
  topic: keywords
creator: Grace Ndlovu
creator: Samuel Johnson
rights: Copyright (c) 2025
date: 2025-10-04
publication date: 2025-10-04
starting page: 01
ending page: 15
doi: 10.67228/3142788X/IJMLPA-2025PII6E3D

Federated Continual Learning for Privacy-Preserving Predictive Intelligence
type: item
description: Federated Learning (FL) enables privacy-preserving collaborative model training without sharing raw data but faces challenges in handling concept drift, non-IID data, and evolving tasks. Although Continual Learning (CL) supports lifelong knowledge adaptation and mitigates catastrophic forgetting, most existing approaches are designed for centralized environments. To address these limitations, this paper proposes the Federated Continual Learning framework for Privacy-Preserving Predictive Intelligence (FCL3Pi), which integrates federated optimization with continual learning to enable adaptive, decentralized, and privacy-preserving predictive intelligence. The framework incorporates decentralized model aggregation, local incremental learning, dynamic memory replay, adaptive regularization, and secure communication to improve learning under dynamic data distributions. It addresses key challenges including catastrophic forgetting, data heterogeneity, client drift, communication efficiency, scalability, and edge resource constraints. Experimental evaluation demonstrates improved prediction accuracy, knowledge retention, privacy preservation, communication efficiency, and convergence stability compared with conventional centralized learning, standalone continual learning, and traditional federated learning. The proposed framework provides a robust foundation for next-generation intelligent applications in healthcare, industrial automation, autonomous transportation, financial systems, smart cities, and large-scale IoT environments.
subject: Articles
  topic: section
subject: Federated Learning
  topic: keywords
subject: Continual Learning
  topic: keywords
subject: Privacy-Preserving Artificial Intelligence
  topic: keywords
subject: Predictive Intelligence
  topic: keywords
subject: Lifelong Learning
  topic: keywords
subject: Edge Intelligence
  topic: keywords
subject: Distributed Machine Learning
  topic: keywords
subject: Non-IID Learning
  topic: keywords
subject: Catastrophic Forgetting
  topic: keywords
subject: Secure Model Aggregation
  topic: keywords
creator: Lothar Collatz
rights: Copyright (c) 2025
date: 2025-07-05
publication date: 2025-07-05
starting page: 01
ending page: 19
doi: 10.67228/3142788X/IJMLPA-2025PII4U5C

Physics-Informed Machine Learning Models for Reliable Time-Series Forecasting
type: item
description: Time-series forecasting is considered as one of the cornerstones for intelligent decision-making in various application domains such as renewable energy systems, healthcare, financial markets, climate science, industrial automation and smart transportation. While state-of-the-art deep learning models such as Long Short-Term Memory (LSTM), Gated Recurrent Unit (GRU) and Transformer architectures can produce impressive predictions when trained on a sequence of historical observations, these techniques are primarily data-driven approaches that ignore governing physical principles of dynamic systems. As a consequence, such models can make physically inconsistent predictions, generalise poorly under distributional shifts or use prohibitively large amounts of labeled training data. Common approaches that have been recently introduced to leverage existing domain-specific physical knowledge with data-driven learning to obtain more accurate, robust and interpretable predictions include Physics-Informed Machine Learning (PIML).
subject: Articles
  topic: section
subject: Physics-Informed Machine Learning (PIML)
  topic: keywords
subject: Physics-Informed Neural Networks (PINNs)
  topic: keywords
subject: Time-Series Forecasting
  topic: keywords
subject: Deep Learning
  topic: keywords
subject: Scientific Machine Learning
  topic: keywords
subject: Long Short-Term Memory (LSTM)
  topic: keywords
subject: Transformer Networks
  topic: keywords
subject: Hybrid Modeling
  topic: keywords
subject: Differential Equations
  topic: keywords
subject: Reliable Artificial Intelligence
  topic: keywords
creator: Andrew Collins
rights: Copyright (c) 2025
date: 2025-11-05
publication date: 2025-11-05
starting page: 01
ending page: 15
doi: 10.67228/3142788X/IJMLPA-2025PII3W2S

Causal Machine Learning Frameworks for Robust Predictive Modeling in Dynamic Environments
type: item
description: Artificial Intelligence (AI) and Machine Learning (ML) have significantly improved predictive analytics across domains such as healthcare, finance, transportation, cybersecurity, manufacturing, and smart cities. However, conventional ML models rely on statistical correlations and often fail under dynamic environments due to concept drift, distribution shifts, and changing causal relationships. Causal Machine Learning (CML) addresses these limitations by integrating causal inference techniques, including structural causal models, directed acyclic graphs (DAGs), counterfactual reasoning, intervention analysis, and invariant causal prediction, to identify true cause-and-effect relationships. This enables more interpretable, robust, and generalizable predictive models. This paper proposes a unified CML framework that combines data preprocessing, causal graph construction, structural causal modeling, causal feature optimization, predictive learning, intervention analysis, and continuous model adaptation. Mathematical formulations support causal dependency estimation, structural equation modeling, invariant risk minimization, and prediction optimization. Experimental results demonstrate improved out-of-distribution prediction, robustness, causal consistency, explainability, and computational efficiency, providing a scalable foundation for trustworthy and adaptive AI in dynamic environments.
subject: Articles
  topic: section
subject: Causal Machine Learning
  topic: keywords
subject: Causal Inference
  topic: keywords
subject: Predictive Modeling
  topic: keywords
subject: Dynamic Environments
  topic: keywords
subject: Structural Causal Models
  topic: keywords
subject: Counterfactual Learning
  topic: keywords
subject: Domain Adaptation
  topic: keywords
subject: Distribution Shift
  topic: keywords
subject: Explainable Artificial Intelligence
  topic: keywords
subject: Robust Machine Learning
  topic: keywords
creator: Mahabala H. N
rights: Copyright (c) 2025
date: 2025-09-02
publication date: 2025-09-02
starting page: 01
ending page: 17
doi: 10.67228/3142788X/IJMLPA-2025PII3S4X

Hybrid Knowledge Graph and Large Language Model Architectures for Predictive Analytics
type: item
description: Artificial Intelligence has significantly advanced predictive analytics, but traditional machine learning and deep learning models often struggle to integrate structured knowledge and provide explainable reasoning. Hybrid Knowledge Graph–Large Language Model (KG–LLM) architectures address these limitations by combining the structured semantic representation of Knowledge Graphs with the contextual reasoning capabilities of LLMs. This paper reviews hybrid KG–LLM frameworks for predictive analytics, highlighting graph embeddings, Retrieval-Augmented Generation (RAG), transformer-based reasoning, and contextual embedding fusion to improve prediction accuracy, interpretability, and robustness. The framework supports applications including healthcare, finance, cybersecurity, manufacturing, and customer analytics. Performance is evaluated using standard metrics such as Accuracy, Precision, Recall, F1-Score, AUC, and MAE, demonstrating superior results over standalone approaches. The paper also discusses scalability, computational challenges, explainable AI, federated learning, multimodal knowledge graphs, and future directions for trustworthy AI-driven predictive analytics.
subject: Articles
  topic: section
subject: Hybrid Artificial Intelligence
  topic: keywords
subject: Knowledge Graphs
  topic: keywords
subject: Large Language Models
  topic: keywords
subject: Predictive Analytics
  topic: keywords
subject: Graph Neural Networks
  topic: keywords
subject: Semantic Reasoning
  topic: keywords
subject: Retrieval-Augmented Generation (RAG)
  topic: keywords
subject: Explainable Artificial Intelligence (XAI)
  topic: keywords
subject: Transformer Models
  topic: keywords
subject: Machine Learning
  topic: keywords
subject: Deep Learning
  topic: keywords
subject: Graph Embeddings
  topic: keywords
subject: Contextual Intelligence
  topic: keywords
subject: Decision Support Systems
  topic: keywords
creator: Meena Krishnan
rights: Copyright (c) 2025
date: 2025-12-04
publication date: 2025-12-04
starting page: 01
ending page: 17
doi: 10.67228/3142788X/IJMLPA-2025PII2J5L

Large Language Model-Augmented Machine Learning Pipelines for Automated Predictive Intelligence
type: item
description: Data-driven applications across healthcare, manufacturing, finance, transportation, cybersecurity, smart cities, and Industrial Internet of Things (IIoT) require intelligent predictive systems that are accurate, explainable, and capable of real-time decision-making. While conventional machine learning (ML) pipelines effectively automate tasks such as data preprocessing, feature engineering, model training, and deployment, they often lack contextual reasoning, adaptive intelligence, and explainability when handling heterogeneous and multimodal data. Recent advances in Large Language Models (LLMs) offer new opportunities to enhance ML pipelines through semantic reasoning, intelligent feature generation, automated model optimization, and explainable predictions. This research proposes a Large Language Model-Augmented Machine Learning Pipeline (LLM-MLP) that integrates data acquisition, intelligent preprocessing, semantic feature engineering, automated model selection, hyperparameter optimization, explainable AI, continuous monitoring, and feedback-driven refinement within a unified framework. By combining LLM-based reasoning with traditional ML techniques, the proposed architecture improves predictive accuracy, interpretability, scalability, and computational efficiency. The framework supports continuous learning through reinforcement-based optimization and is applicable to diverse domains, including healthcare diagnosis, predictive maintenance, financial risk assessment, cybersecurity, customer analytics, and smart infrastructure management. Overall, the proposed LLM-MLP provides an adaptive, trustworthy, and scalable predictive intelligence framework for next-generation AI-driven decision support systems.
subject: Articles
  topic: section
subject: Large Language Models (Llms)
  topic: keywords
subject: Machine Learning Pipelines
  topic: keywords
subject: Predictive Intelligence
  topic: keywords
subject: Explainable Artificial Intelligence (XAI)
  topic: keywords
subject: Automated Machine Learning (Automl)
  topic: keywords
subject: Transformer Models
  topic: keywords
subject: Semantic Feature Engineering
  topic: keywords
subject: Intelligent Decision Support
  topic: keywords
subject: Predictive Analytics
  topic: keywords
subject: Artificial Intelligence
  topic: keywords
creator: Andrey Ershov
rights: Copyright (c) 2025
date: 2025-02-05
publication date: 2025-02-05
starting page: 01
ending page: 17
doi: 10.67228/3142788X/IJMLPA-2025PI3V8X

Foundation Model Distillation Techniques for Resource-Efficient Predictive Analytics
type: item
description: Foundation models have significantly improved predictive analytics across healthcare, finance, manufacturing, cybersecurity, transportation, retail, and scientific research by enabling accurate forecasting, classification, anomaly detection, and intelligent decision support. However, their large computational requirements, memory consumption, energy usage, and inference latency limit deployment on resource-constrained platforms such as edge devices, IoT systems, mobile devices, and embedded applications. Knowledge distillation has emerged as an effective approach for developing resource-efficient AI by transferring knowledge from large teacher models to compact student models while preserving predictive performance. Unlike conventional compression techniques, it retains semantic representations and improves model efficiency through advanced strategies such as feature distillation, self-distillation, multi-teacher learning, and adaptive optimization. This paper proposes a Foundation Model Distillation Framework (FMDF) for predictive analytics in heterogeneous computing environments. The framework integrates teacher–student learning, adaptive feature distillation, multi-level knowledge transfer, dynamic loss optimization, and resource-aware inference to enable efficient deployment across cloud, edge, mobile, and embedded platforms. The proposed methodology includes foundation model training, hierarchical knowledge distillation, lightweight model optimization, and continuous performance evaluation. Mathematical formulations support knowledge transfer, prediction optimization, computational efficiency, and model compression. Experimental results demonstrate that FMDF significantly reduces model complexity while maintaining high predictive accuracy, scalability, robustness, and energy efficiency, making it a promising solution for resource-efficient predictive AI, edge intelligence, federated learning, digital twins, and next-generation intelligent decision support syste…
subject: Articles
  topic: section
subject: Foundation Models
  topic: keywords
subject: Knowledge Distillation
  topic: keywords
subject: Predictive Analytics
  topic: keywords
subject: Resource-Efficient Artificial Intelligence
  topic: keywords
subject: Model Compression
  topic: keywords
subject: Edge Intelligence
  topic: keywords
subject: Teacher–Student Learning
  topic: keywords
subject: Machine Learning Optimization
  topic: keywords
subject: Deep Learning
  topic: keywords
subject: Computational Efficiency
  topic: keywords
creator: Ken Iverson
rights: Copyright (c) 2025
date: 2025-05-05
publication date: 2025-05-05
starting page: 01
ending page: 17
doi: 10.67228/3142788X/IJMLPA-2025PI7Y6E

Uncertainty-Aware Machine Learning Models for Trustworthy Predictive Decision Support Systems
type: item
description: Predictive Decision Support Systems (PDSS) increasingly rely on machine learning, but conventional models often provide deterministic predictions without measuring uncertainty, limiting their reliability in high-stakes applications. This paper proposes an uncertainty-aware machine learning framework that integrates uncertainty quantification, probabilistic modeling, explainable AI, and adaptive learning to improve prediction reliability, transparency, and decision confidence. The framework models both aleatoric and epistemic uncertainties, producing confidence scores, prediction intervals, and interpretable decision reports instead of single-point predictions. By combining intelligent data preprocessing, uncertainty-aware learning, trustworthy decision intelligence, and continuous model adaptation, the proposed approach enhances robustness, calibration, explainability, and trustworthiness, providing a scalable foundation for reliable predictive decision support in dynamic real-world environments.
subject: Articles
  topic: section
subject: Uncertainty-Aware Machine Learning
  topic: keywords
subject: Predictive Decision Support Systems
  topic: keywords
subject: Trustworthy Artificial Intelligence
  topic: keywords
subject: Bayesian Learning
  topic: keywords
subject: Explainable Artificial Intelligence (XAI)
  topic: keywords
subject: Decision Intelligence
  topic: keywords
subject: Uncertainty Quantification
  topic: keywords
subject: Predictive Analytics
  topic: keywords
subject: Confidence Estimation
  topic: keywords
subject: Risk-Aware Decision Making
  topic: keywords
creator: David Wheeler
creator: Michael Gordon
rights: Copyright (c) 2025
date: 2025-04-04
publication date: 2025-04-04
starting page: 01
ending page: 15
doi: 10.67228/3142788X/IJMLPA-2025PI7J6D

Federated Predictive Learning with Privacy-Aware Model Aggregation for Distributed Analytics
type: item
description: The rapid growth of IoT, edge computing, healthcare, and cyber-physical systems has increased the need for privacy-preserving distributed analytics. Traditional centralized machine learning requires sharing raw data, creating privacy, regulatory, and communication challenges. Federated Learning (FL) enables collaborative model training without exchanging sensitive data but faces limitations such as Non-IID data, communication overhead, privacy leakage, malicious updates, and inefficient aggregation. To address these issues, this study proposes a Federated Predictive Learning with Privacy-Aware Model Aggregation (FPL-PAMA) framework. The framework combines secure local training, privacy-aware weighted aggregation, client trust evaluation, and adaptive optimization to improve prediction accuracy, privacy protection, and communication efficiency. It is suitable for applications including healthcare, IoT, smart manufacturing, transportation, and financial fraud detection, providing a secure and scalable solution for next-generation distributed intelligent systems.
subject: Articles
  topic: section
subject: Federated Learning
  topic: keywords
subject: Distributed Analytics
  topic: keywords
subject: Privacy Preservation
  topic: keywords
subject: Predictive Learning
  topic: keywords
subject: Model Aggregation
  topic: keywords
subject: Secure Machine Learning
  topic: keywords
subject: Edge Computing
  topic: keywords
subject: Artificial Intelligence
  topic: keywords
subject: Distributed Optimization
  topic: keywords
subject: Federated Averaging
  topic: keywords
subject: Privacy-Aware Aggregation
  topic: keywords
subject: Machine Learning Security
  topic: keywords
creator: H. N. Mahabala
creator: N. Seshagiri
rights: Copyright (c) 2025
date: 2025-01-03
publication date: 2025-01-03
starting page: 01
ending page: 15
doi: 10.67228/3142788X/IJMLPA-2025PI6L4G

Continual Learning Frameworks for Adaptive Predictive Analytics in Non-Stationary Data Streams
type: item
description: Predictive analytics increasingly relies on real-time, non-stationary data from healthcare, finance, cybersecurity, industrial automation, intelligent transportation, and IoT, where traditional machine learning models struggle to adapt to evolving data distributions. Continual Learning (CL), also known as lifelong or incremental learning, addresses these challenges by continuously learning new knowledge while preserving previously acquired knowledge, thereby mitigating catastrophic forgetting. This paper presents a unified continual learning framework for adaptive predictive analytics that integrates concept drift detection, adaptive feature representation, memory management, experience replay, regularization-based learning, and online model updating. The framework enables continuous adaptation to changing data while maintaining long-term predictive performance. Performance is evaluated using metrics such as prediction accuracy, precision, recall, F1-score, concept adaptation rate, forgetting rate, computational efficiency, and learning stability. Experimental results demonstrate that the proposed approach outperforms conventional static learning models by improving predictive accuracy, adaptability, and computational efficiency under dynamic conditions. The framework provides a scalable foundation for intelligent predictive systems with applications in fraud detection, predictive maintenance, medical diagnosis, cybersecurity, smart manufacturing, intelligent transportation, climate forecasting, and smart healthcare.
subject: Articles
  topic: section
subject: Continual Learning
  topic: keywords
subject: Adaptive Predictive Analytics
  topic: keywords
subject: Non-Stationary Data Streams
  topic: keywords
subject: Concept Drift
  topic: keywords
subject: Lifelong Learning
  topic: keywords
subject: Online Learning
  topic: keywords
subject: Incremental Learning
  topic: keywords
subject: Artificial Intelligence
  topic: keywords
subject: Machine Learning
  topic: keywords
subject: Predictive Modeling
  topic: keywords
creator: N. Seshagiri
creator: H. N. Mahabala
rights: Copyright (c) 2025
date: 2025-03-05
publication date: 2025-03-05
starting page: 01
ending page: 16
doi: 10.67228/3142788X/IJMLPA-2025PI2W6E

Foundation Model-Based Predictive Analytics for Multi-Domain Decision Intelligence
type: item
description: Predictive analytics is rapidly evolving through Artificial Intelligence (AI), particularly with the emergence of foundation models that enable scalable, transferable, and context-aware intelligence across multiple domains. Unlike traditional machine learning models, foundation models leverage large-scale multimodal pretraining and efficient task-specific adaptation, enabling superior reasoning, zero-shot learning, and cross-domain knowledge transfer. This paper proposes the Foundation Model-Based Predictive Analytics Framework for Multi-Domain Decision Intelligence (FMPA-MDI), an integrated architecture that combines heterogeneous data acquisition, multimodal preprocessing, semantic representation learning, transformer-based predictive reasoning, retrieval-augmented learning, knowledge graph integration, explainable AI (XAI), and intelligent decision optimization. The framework supports structured and unstructured data while incorporating transfer learning, attention mechanisms, semantic embeddings, and continuous feedback for adaptive decision-making. Mathematical formulations model feature representation, semantic similarity, predictive confidence, and optimization. The proposed framework enhances prediction accuracy, scalability, interpretability, and computational efficiency, providing a robust foundation for next-generation intelligent decision support across healthcare, finance, manufacturing, smart cities, and other enterprise domains.
subject: Articles
  topic: section
subject: Foundation Models
  topic: keywords
subject: Predictive Analytics
  topic: keywords
subject: Multi-Domain Decision Intelligence
  topic: keywords
subject: Artificial Intelligence
  topic: keywords
subject: Large Language Models
  topic: keywords
subject: Transformer Networks
  topic: keywords
subject: Transfer Learning
  topic: keywords
subject: Explainable Artificial Intelligence (XAI)
  topic: keywords
subject: Multimodal Learning
  topic: keywords
subject: Knowledge Graphs
  topic: keywords
subject: Enterprise Intelligence
  topic: keywords
subject: Decision Support Systems
  topic: keywords
creator: N. Seshagiri
rights: Copyright (c) 2024
date: 2024-11-04
publication date: 2024-11-04
starting page: 01
ending page: 16
doi: 10.67228/3142788X/IJMLPA-2024PII6L1A

Hybrid Statistical–Machine Learning Approaches for Predictive Analysis
type: item
description: Predictive analytics plays a crucial role in data science by forecasting future trends using historical data. Traditional statistical techniques such as linear regression, logistic regression, ARIMA, and Bayesian inference provide interpretable and mathematically rigorous models but often struggle with large-scale, complex, and nonlinear datasets. Machine learning approaches, including Decision Trees, Support Vector Machines, Random Forests, Artificial Neural Networks, and Ensemble Learning, offer superior predictive capabilities but may lack interpretability and uncertainty estimation. To address these limitations, hybrid statistical–machine learning methods have emerged, combining statistical feature engineering, probabilistic modeling, and machine learning algorithms to improve prediction accuracy and robustness. This paper reviews the theoretical foundations, architectures, and applications of hybrid predictive models across finance, healthcare, manufacturing, transportation, and business intelligence. A generalized hybrid framework incorporating feature selection, model training, ensemble optimization, and validation is presented. The analysis indicates that hybrid approaches consistently outperform standalone statistical and machine learning models in terms of accuracy, reliability, and generalization. Key implementation challenges, including computational complexity, interpretability, data quality, and parameter optimization, are also discussed. The study concludes that hybrid statistical–machine learning models represent a promising direction for next-generation predictive analytics and intelligent decision-support systems.
subject: Articles
  topic: section
subject: Predictive Analytics
  topic: keywords
subject: Statistical Learning
  topic: keywords
subject: Machine Learning
  topic: keywords
subject: Hybrid Models
  topic: keywords
subject: Regression Analysis
  topic: keywords
subject: Artificial Neural Networks
  topic: keywords
subject: Ensemble Learning
  topic: keywords
subject: Data Mining
  topic: keywords
subject: Forecasting Systems
  topic: keywords
subject: Predictive Modelling
  topic: keywords
creator: Arvind Kumar Singh
rights: Copyright (c) 2024
date: 2024-07-02
publication date: 2024-07-02
starting page: 01
ending page: 16
doi: 10.67228/3142788X/IJMLPA-2024PII9B8H

Knowledge-Based Machine Learning Models for Decision Support Systems
type: item
description: Decision Support Systems (DSS) are widely used in healthcare, finance, manufacturing, education, transportation, and public administration to support data-driven decision-making. Traditional DSS based on rule-based expert systems and statistical models often struggle to adapt to dynamic and complex environments. To address these limitations, Knowledge-Based Machine Learning (KBML) integrates machine learning with symbolic knowledge representation techniques such as ontologies, semantic networks, expert rules, and domain constraints. By incorporating prior knowledge into the learning process, KBML enhances reasoning, interpretability, transparency, and predictive performance while reducing training requirements. This paper reviews knowledge-based machine learning approaches for intelligent DSS and examines the integration of knowledge engineering principles with supervised, unsupervised, reinforcement, and ensemble learning methods. The roles of ontologies, rule-based inference, semantic reasoning, and knowledge graphs in improving learning effectiveness are also discussed. A comprehensive DSS framework is proposed, consisting of knowledge acquisition, data preprocessing, feature engineering, knowledge representation, model training, inference generation, and decision recommendation modules. Experimental results demonstrate that knowledge-enhanced models achieve higher accuracy, improved decision consistency, reduced uncertainty, and greater interpretability than conventional machine learning approaches. The study also highlights challenges related to knowledge acquisition, scalability, ontology maintenance, and system integration. Future research directions include explainable AI, deep knowledge graphs, federated learning, cognitive computing, and autonomous reasoning systems.
subject: Articles
  topic: section
subject: Decision Support Systems
  topic: keywords
subject: Knowledge-Based Systems
  topic: keywords
subject: Machine Learning
  topic: keywords
subject: Artificial Intelligence
  topic: keywords
subject: Expert Systems
  topic: keywords
subject: Knowledge Representation
  topic: keywords
subject: Ontology Engineering
  topic: keywords
subject: Semantic Reasoning
  topic: keywords
subject: Intelligent Systems
  topic: keywords
subject: Predictive Analytics
  topic: keywords
creator: Kevin Taylor
rights: Copyright (c) 2024
date: 2024-08-04
publication date: 2024-08-04
starting page: 01
ending page: 15
doi: 10.67228/3142788X/IJMLPA-2024PII4W6

Automated Predictive Model Selection Using Meta-Learning Techniques
type: item
description: Recent advances in machine learning have produced numerous predictive algorithms for classification, regression, and forecasting tasks. However, selecting the most suitable model for a specific dataset remains challenging, often requiring expert knowledge, extensive experimentation, and significant computational resources. To address this issue, automated model selection has emerged as an important research area within machine learning and intelligent decision-support systems. Meta-learning, or “learning to learn,” provides an effective solution by utilizing knowledge gained from previously analyzed datasets to predict the performance of learning algorithms on new datasets. It examines dataset characteristics, known as meta-features, and recommends appropriate machine learning models, thereby improving selection accuracy while reducing computational costs. This study proposes a comprehensive meta-learning framework for automated predictive model selection. The framework includes dataset characterization, meta-feature extraction, meta-dataset generation, algorithm evaluation, and meta-model construction. Statistical, information-theoretic, landmarking, and complexity-based features are used to describe datasets and train a meta-learning model capable of recommending suitable algorithms for new predictive tasks. The research evaluates several popular machine learning algorithms, including Decision Trees, Support Vector Machines, Random Forests, Naïve Bayes, Artificial Neural Networks, and k-Nearest Neighbor classifiers. Experimental results demonstrate that meta-learning significantly improves model recommendation accuracy compared to traditional trial-and-error approaches while reducing training time and computational overhead. As part of the broader field of Automated Machine Learning (AutoML), the proposed framework offers an intelligent algorithm recommendation system that supports efficient resource utilization and assists practitioners in selecting high-performi…
subject: Articles
  topic: section
subject: Meta-Learning
  topic: keywords
subject: Automated Machine Learning
  topic: keywords
subject: Model Selection
  topic: keywords
subject: Predictive Analytics
  topic: keywords
subject: Algorithm Recommendation
  topic: keywords
subject: Data Mining
  topic: keywords
subject: Classification
  topic: keywords
subject: Machine Learning
  topic: keywords
creator: Pooja Agarwal
creator: Rakesh Chandra
rights: Copyright (c) 2024
date: 2024-09-01
publication date: 2024-09-01
starting page: 01
ending page: 15
doi: 10.67228/3142788X/IJMLPA-2024PII6N3Q

Machine Learning Frameworks for Large-Scale Data Forecasting
type: item
description: Machine learning has become a critical technology for large-scale data forecasting across industries such as finance, healthcare, transportation, manufacturing, energy, and e-commerce. While traditional forecasting methods like linear regression, ARIMA, and exponential smoothing perform well on smaller datasets, they struggle to manage the volume, velocity, and complexity of modern big data. Machine learning frameworks such as TensorFlow, Apache Spark MLlib, H2O.ai, Scikit-learn, and XGBoost offer scalable solutions by processing large datasets, identifying complex patterns, and generating accurate predictions through distributed computing.This study reviews machine learning architectures for large-scale forecasting, covering forecasting evolution, key algorithms, framework architectures, data processing pipelines, and evaluation methods. It proposes a scalable forecasting framework consisting of data collection, preprocessing, feature engineering, model training, forecasting, and performance evaluation. Findings indicate that distributed machine learning frameworks improve forecasting accuracy while reducing computational costs. Ensemble learning and gradient boosting techniques demonstrate superior performance, scalability, and robustness compared to traditional methods. The study concludes that machine learning frameworks provide a strong foundation for large-scale forecasting and will play an increasingly important role in future predictive applications.
subject: Articles
  topic: section
subject: Large-Scale Forecasting
  topic: keywords
subject: Machine Learning Frameworks
  topic: keywords
subject: Predictive Analytics
  topic: keywords
subject: Big Data
  topic: keywords
subject: Distributed Computing
  topic: keywords
subject: Apache Spark
  topic: keywords
subject: TensorFlow
  topic: keywords
subject: Ensemble Learning
  topic: keywords
subject: Forecasting Models
  topic: keywords
subject: Data Mining
  topic: keywords
creator: John Peterson
rights: Copyright (c) 2024
date: 2024-10-03
publication date: 2024-10-03
starting page: 01
ending page: 16
doi: 10.67228/3142788X/IJMLPA-2024PII2V9R

Intelligent Model Calibration for Improved Prediction Accuracy
type: item
description: Model calibration is essential for improving the reliability of predictive analytics, machine learning, and intelligent decision-support systems. While traditional evaluation metrics such as accuracy, precision, and recall measure classification performance, they do not assess the confidence of model predictions. Calibration aligns predicted probabilities with actual outcomes, enhancing trustworthiness and interpretability. This study proposes an intelligent model calibration framework that integrates adaptive calibration techniques, including Platt Scaling, Isotonic Regression, Bayesian Calibration, Ensemble Calibration, Temperature Scaling, and Meta-Learning-based Calibration. The framework incorporates data preprocessing, baseline model development, calibration parameter optimization, uncertainty estimation, and performance evaluation. Metrics such as Brier Score, Expected Calibration Error (ECE), Maximum Calibration Error (MCE), and Log-Loss are used to assess reliability. Experimental results on benchmark datasets show that calibrated models significantly reduce calibration errors, improve probability estimates, enhance predictive performance, and increase robustness under varying data distributions and uncertainty levels. The findings highlight intelligent calibration as a key mechanism for building trustworthy AI systems and improving decision-making in high-stakes applications.
subject: Articles
  topic: section
subject: Model Calibration
  topic: keywords
subject: Prediction Accuracy
  topic: keywords
subject: Machine Learning
  topic: keywords
subject: Probability Estimation
  topic: keywords
subject: Intelligent Systems
  topic: keywords
subject: Uncertainty Quantification
  topic: keywords
subject: Predictive Analytics
  topic: keywords
subject: Calibration Error
  topic: keywords
subject: Artificial Intelligence
  topic: keywords
creator: Arvind Kumar Singh
creator: Lakshmi Narayanan
rights: Copyright (c) 2024
date: 2024-03-02
publication date: 2024-03-02
starting page: 01
ending page: 16
doi: 10.67228/3142788X/IJMLPA-2024PI9P8X

AI-Driven Data Sampling Strategies for Efficient Model Training
type: item
description: Artificial Intelligence (AI) and Machine Learning (ML) are widely used across industries such as healthcare, finance, manufacturing, transportation, cybersecurity, and scientific computing to solve complex problems. The effectiveness of ML models depends heavily on the quality and representativeness of training data. However, the rapid growth of big data has increased computational costs, memory requirements, and training times, making traditional full-dataset training inefficient.To address these challenges, intelligent data sampling has emerged as an important research area. AI-based sampling techniques—including random sampling, stratified sampling, importance sampling, active learning, uncertainty sampling, reinforcement learning-based sampling, and adaptive data selection—identify the most informative data points while reducing redundancy. These methods improve computational efficiency, enhance class representation, and accelerate model training without significantly affecting accuracy. This study reviews the evolution of AI-driven sampling strategies and proposes an adaptive framework that combines statistical sampling with intelligent decision-making mechanisms for real-time data selection. Experimental results demonstrate that intelligent sampling can reduce training data requirements by 30–60% while maintaining over 95% of the predictive performance achieved using full datasets. The approach also improves scalability, reduces energy consumption, and supports efficient deployment of modern machine learning systems. Overall, AI-based sampling provides a practical and effective solution for optimizing data usage and enhancing machine learning performance in large-scale applications.
subject: Articles
  topic: section
subject: Artificial Intelligence
  topic: keywords
subject: Data Sampling
  topic: keywords
subject: Machine Learning
  topic: keywords
subject: Active Learning
  topic: keywords
subject: Importance Sampling
  topic: keywords
subject: Model Training
  topic: keywords
subject: Big Data Analytics
  topic: keywords
subject: Deep Learning
  topic: keywords
subject: Computational Efficiency
  topic: keywords
subject: Intelligent Data Selection
  topic: keywords
creator: K. Balasubramanian
creator: Meena Krishnan
rights: Copyright (c) 2024
date: 2024-01-03
publication date: 2024-01-03
starting page: 01
ending page: 17
doi: 10.67228/3142788X/IJMLPA-2024PI7T2C

AI-Based Predictive Analytics Frameworks for Data-Driven Organizations
type: item
description: AI-powered predictive analytics has emerged as a critical tool for modern organizations, enabling data-driven decision-making and strategic planning through the analysis of large-scale structured and unstructured data. By integrating machine learning, deep learning, natural language processing, and optimization techniques, predictive analytics frameworks can identify patterns, forecast future outcomes, and reduce organizational risks. This study presents a comprehensive framework that includes data acquisition, preprocessing, feature engineering, predictive modeling, evaluation, and decision support. The framework emphasizes data quality, computational efficiency, algorithm selection, and model interpretability. Applications across finance, healthcare, manufacturing, retail, and supply chain management demonstrate the effectiveness of AI in improving forecasting accuracy and operational performance. Comparative analysis shows that AI-based models outperform traditional statistical methods in accuracy, adaptability, scalability, and decision support. The study also highlights the role of explainable AI in enhancing transparency and trust, concluding that predictive analytics is a key enabler of intelligent enterprises and future data-driven innovation.
subject: Articles
  topic: section
subject: Artificial Intelligence
  topic: keywords
subject: Predictive Analytics
  topic: keywords
subject: Machine Learning
  topic: keywords
subject: Data-Driven Organizations
  topic: keywords
subject: Business Intelligence
  topic: keywords
subject: Deep Learning
  topic: keywords
subject: Forecasting Models
  topic: keywords
subject: Decision Support Systems
  topic: keywords
creator: Pooja Agarwal
creator: Rakesh Chandra
rights: Copyright (c) 2024
date: 2024-05-05
publication date: 2024-05-05
starting page: 01
ending page: 15
doi: 10.67228/3142788X/IJMLPA-2024PI6K3D

Machine Learning Approaches for Adaptive Forecasting Systems
type: item
description: Adaptive forecasting systems have become essential for analyzing dynamic and uncertain real-world data, where traditional static forecasting models often fail due to changing patterns, concept drift, and non-stationary conditions. Machine learning techniques, including supervised learning, ensemble methods, neural networks, and hybrid models, enable continuous learning and improved prediction accuracy by adapting to new data. This study reviews machine learning-based adaptive forecasting approaches and presents a generalized framework comprising data acquisition, preprocessing, feature engineering, adaptive learning, forecasting, and performance evaluation. Special emphasis is placed on model updating, online learning, feature selection, and dynamic parameter optimization. Experimental results show that adaptive machine learning models outperform conventional forecasting methods in accuracy, responsiveness, and robustness, making them highly effective for large-scale predictive applications across finance, healthcare, energy, transportation, and industrial systems. The study highlights their potential to support next-generation intelligent forecasting and predictive analytics systems.
subject: Articles
  topic: section
subject: Adaptive Forecasting
  topic: keywords
subject: Machine Learning
  topic: keywords
subject: Predictive Analytics
  topic: keywords
subject: Online Learning
  topic: keywords
subject: Concept Drift
  topic: keywords
subject: Time Series Forecasting
  topic: keywords
subject: Neural Networks
  topic: keywords
subject: Ensemble Learning
  topic: keywords
subject: Forecast Accuracy
  topic: keywords
subject: Intelligent Systems
  topic: keywords
creator: Yuki Nakamura
rights: Copyright (c) 2024
date: 2024-04-04
publication date: 2024-04-04
starting page: 01
ending page: 16
doi: 10.67228/3142788X/IJMLPA-2024PI4R6H

Predictive Modeling Techniques for Complex Multivariate Data
type: item
description: Predictive modeling has become increasingly important as digital transformation, sensing technologies, and large-scale data collection generate complex multivariate datasets across domains such as healthcare, finance, engineering, and industry. These datasets often contain nonlinear relationships, uncertainty, noise, and high dimensionality, making traditional statistical methods less effective. Advanced machine learning techniques, including Random Forests, Support Vector Regression, Artificial Neural Networks, and deep learning models, offer improved predictive accuracy and robustness for such complex data. This study presents a systematic review of predictive modeling approaches and proposes a framework comprising data preprocessing, feature selection, model development, training, validation, and performance evaluation. Comparative analysis of Multiple Linear Regression, Random Forest, Support Vector Regression, and Artificial Neural Networks demonstrates that ensemble and neural network-based models outperform traditional methods, particularly in handling noisy and highly correlated variables. The findings also highlight the importance of feature selection and dimensionality reduction in improving computational efficiency and model generalization. The proposed framework provides valuable guidance for developing reliable predictive systems in modern data-driven environments.
subject: Articles
  topic: section
subject: Predictive Modeling
  topic: keywords
subject: Machine Learning
  topic: keywords
subject: Multivariate Data Analysis
  topic: keywords
subject: Artificial Neural Networks
  topic: keywords
subject: Random Forest
  topic: keywords
subject: Support Vector Machines
  topic: keywords
subject: Data Mining
  topic: keywords
subject: Predictive Analytics
  topic: keywords
subject: Feature Selection
  topic: keywords
subject: Big Data
  topic: keywords
creator: Chloe Bernard
rights: Copyright (c) 2024
date: 2026-07-10
publication date: 2026-07-10
starting page: 01
ending page: 16
doi: 10.67228/3142788X/IJMLPA-2024PI1H4M

Sparse Machine Learning Models for High-Dimensional Data Analysis
type: item
description: High-dimensional data analysis has become increasingly important in machine learning, computational intelligence, bioinformatics, finance, and image processing due to the rapid growth of large-scale datasets generated by IoT, cloud computing, and digital technologies. These datasets often contain thousands of features with limited samples, creating challenges such as overfitting, high computational complexity, redundancy, and the curse of dimensionality. Sparse machine learning models address these issues by using sparsity constraints and regularization techniques to select the most relevant features while eliminating irrelevant data. Popular methods include LASSO, Elastic Net, Sparse PCA, Sparse Autoencoders, and Sparse Support Vector Machines. These approaches improve interpretability, scalability, computational efficiency, and predictive performance. Sparse learning is widely applied in genomics, cybersecurity, medical diagnosis, recommender systems, and industrial automation. This study reviews sparse optimization, feature selection, and sparse representation learning techniques for high-dimensional data analysis. Experimental findings show that sparse models provide better robustness, faster convergence, lower memory usage, and reduced training complexity than traditional dense models. Future research focuses on integrating sparse learning with deep learning, federated learning, reinforcement learning, and explainable AI systems.
subject: Articles
  topic: section
subject: Sparse Machine Learning
  topic: keywords
subject: High-Dimensional Data Analysis
  topic: keywords
subject: Feature Selection
  topic: keywords
subject: LASSO Regularization
  topic: keywords
subject: Sparse Optimization
  topic: keywords
subject: Sparse Representation
  topic: keywords
subject: Dimensionality Reduction
  topic: keywords
subject: Sparse Bayesian Learning
  topic: keywords
subject: Machine Learning Algorithms
  topic: keywords
subject: Computational Intelligence
  topic: keywords
creator: Rajesh Kumar Sharma
creator: Priya Natarajan
rights: Copyright (c) 2023
date: 2023-12-03
publication date: 2023-12-03
starting page: 01
ending page: 15
doi: 10.67228/3142788X/IJMLPA-2023PIII2C9L

AI-Based Automated Feature Selection for Predictive Modeling
type: item
description: Artificial Intelligence (AI) has improved predictive modeling by enabling efficient analysis of large-scale and high-dimensional datasets. Before 2019, selecting relevant features from complex data was a major challenge. Feature selection is important for improving accuracy, reducing computational cost, preventing overfitting, and enhancing model interpretability. Traditional methods such as filter, wrapper, and embedded approaches had limitations with big data and nonlinear relationships. To address these issues, AI-based Automated Feature Selection (AFS) techniques were introduced. These methods combine machine learning, optimization algorithms, and intelligent search strategies to automatically identify the most relevant features. Common approaches included Genetic Algorithms (GA), Particle Swarm Optimization (PSO), Ant Colony Optimization (ACO), Artificial Neural Networks (ANN), Support Vector Machines (SVM), Random Forests (RF), and Reinforcement Learning (RL). This study reviews AI-driven feature selection techniques developed between 2009 and 2018 and proposes a hybrid framework combining filter-based preprocessing, evolutionary optimization, and machine learning evaluation. Experimental results show that AI-based hybrid methods outperform traditional techniques in accuracy, scalability, and feature optimization, demonstrating their importance in modern predictive analytics systems.
subject: Articles
  topic: section
subject: Artificial Intelligence
  topic: keywords
subject: Automated Feature Selection
  topic: keywords
subject: Predictive Modeling
  topic: keywords
subject: Machine Learning
  topic: keywords
subject: Genetic Algorithm
  topic: keywords
subject: Particle Swarm Optimization
  topic: keywords
subject: Classification
  topic: keywords
subject: Dimensionality Reduction
  topic: keywords
subject: Hybrid Optimization
  topic: keywords
subject: Data Mining
  topic: keywords
subject: Evolutionary Computing
  topic: keywords
subject: Intelligent Systems
  topic: keywords
subject: Feature Engineering
  topic: keywords
subject: Support Vector Machine
  topic: keywords
subject: Neural Networks
  topic: keywords
creator: Liu Fang
rights: Copyright (c) 2023
date: 2023-10-03
publication date: 2023-10-03
starting page: 01
ending page: 19
doi: 10.67228/3142788X/IJMLPA-2023PII8X5W

AI-Based Model Evaluation Techniques for Reliable Predictions
type: item
description: Artificial Intelligence (AI) has transformed industries such as healthcare, finance, manufacturing, transportation, agriculture, cybersecurity, and smart cities. As AI increasingly supports critical decision-making, reliable model evaluation has become essential for ensuring accurate and trustworthy predictions. Model evaluation helps identify issues such as overfitting, underfitting, bias, and variance while assessing predictive performance beyond training data. Traditional accuracy-based measures have evolved to include metrics such as precision, recall, F1-score, ROC-AUC, MSE, RMSE, MAE, and cross-validation techniques. Recent advancements in deep learning and ensemble methods have further emphasized the need for uncertainty, reliability, and interpretability assessment. This study reviews classical and modern AI evaluation methods and proposes a structured framework integrating data preprocessing, model development, validation, and performance assessment. Results demonstrate that multi-metric evaluation strategies outperform single-metric approaches, while cross-validation and precision-recall analysis significantly improve predictive reliability. The findings highlight that evaluation metric selection should be application-specific to enhance AI trustworthiness and support robust real-world deployment. Future research should focus on explainable evaluation frameworks, uncertainty quantification, and adaptive validation techniques.
subject: Articles
  topic: section
subject: Artificial Intelligence
  topic: keywords
subject: Machine Learning
  topic: keywords
subject: Model Evaluation
  topic: keywords
subject: Prediction Reliability
  topic: keywords
subject: Cross Validation
  topic: keywords
subject: Accuracy
  topic: keywords
subject: Precision
  topic: keywords
subject: Recall
  topic: keywords
subject: ROC Curve
  topic: keywords
subject: Performance Metrics
  topic: keywords
subject: Predictive Analytics
  topic: keywords
creator: Ajay Krishnan
creator: Ritu Agarwal
rights: Copyright (c) 2023
date: 2023-09-05
publication date: 2023-09-05
starting page: 01
ending page: 16
doi: 10.67228/3142788X/IJMLPA-2023PII6V3P

Hybrid Machine Learning Models for Complex Pattern Detection
type: item
description: Hybrid machine learning approaches have emerged as powerful solutions for complex pattern detection problems in fields such as medical diagnosis, fraud detection, industrial monitoring, cybersecurity, image processing, and bioinformatics. Traditional machine learning algorithms often struggle with high-dimensional, nonlinear, noisy, and heterogeneous data due to limitations like overfitting, parameter sensitivity, and computational inefficiency. To address these issues, hybrid machine learning combines multiple techniques including neural networks, support vector machines, fuzzy systems, evolutionary algorithms, ensemble learning, and probabilistic reasoning within a unified framework. This paper reviews hybrid machine learning models developed before 2019, including Neuro-Fuzzy Systems, Evolutionary Neural Networks, Ensemble Hybrid Models, Deep Hybrid Architectures, and Probabilistic Hybrid Systems. A proposed hybrid framework integrating Convolutional Neural Networks (CNN), Support Vector Machines (SVM), and Genetic Algorithms (GA) is highlighted, where CNN performs feature extraction, SVM handles classification, and GA optimizes feature selection and model parameters. Experimental results on benchmark datasets demonstrate that hybrid models achieve higher accuracy, precision, recall, F1-score, robustness, and adaptability compared to standalone algorithms. The study also discusses challenges such as computational complexity, scalability, interpretability, and training instability, along with solutions like dimensionality reduction, adaptive optimization, distributed learning, and parallel computing. Overall, hybrid machine learning systems are identified as an important step toward scalable, explainable, and intelligent autonomous pattern recognition systems for future AI applications
subject: Articles
  topic: section
subject: Hybrid Machine Learning
  topic: keywords
subject: Complex Pattern Detection
  topic: keywords
subject: Artificial Neural Networks
  topic: keywords
subject: Support Vector Machines
  topic: keywords
subject: Genetic Algorithms
  topic: keywords
subject: Deep Learning
  topic: keywords
subject: Neuro-Fuzzy Systems
  topic: keywords
subject: Ensemble Learning
  topic: keywords
subject: Feature Extraction
  topic: keywords
subject: Intelligent Systems
  topic: keywords
subject: Pattern Recognition
  topic: keywords
subject: Optimization Algorithms
  topic: keywords
subject: Data Mining
  topic: keywords
subject: Classification Systems
  topic: keywords
subject: Computational Intelligence
  topic: keywords
creator: Suresh Babu Reddy
creator: Anita Verma
rights: Copyright (c) 2023
date: 2023-08-04
publication date: 2023-08-04
starting page: 01
ending page: 14
doi: 10.67228/3142788X/IJMLPA-2023PII5D1K

Machine Learning-Based Data Sampling Techniques for Big Data Analytics
type: item
description: The rapid expansion of IoT, cloud computing, social media, and distributed systems has generated massive amounts of data, making big data analytics increasingly important. Traditional sampling methods are often insufficient for handling the complexity and scalability challenges of modern big data environments. To overcome these limitations, machine learning-based sampling techniques have been developed to intelligently select representative data while preserving analytical accuracy. This paper surveys supervised, unsupervised, reinforcement, active, and deep learning-based sampling approaches and their integration with platforms like Hadoop and Apache Spark. Experimental findings show that intelligent sampling improves scalability, accuracy, efficiency, and resource utilization. The study concludes that machine learning-based sampling is a key technology for future big data analytics, with promising directions in hybrid, federated, explainable, and real-time adaptive sampling models.
subject: Articles
  topic: section
subject: Big Data Analytics
  topic: keywords
subject: Machine Learning
  topic: keywords
subject: Intelligent Sampling
  topic: keywords
subject: Data Mining
  topic: keywords
subject: Distributed Computing
  topic: keywords
subject: Adaptive Sampling
  topic: keywords
subject: Feature Selection
  topic: keywords
subject: Hadoop
  topic: keywords
subject: Apache Spark
  topic: keywords
subject: Predictive Analytics
  topic: keywords
subject: Reinforcement Learning
  topic: keywords
subject: Deep Learning
  topic: keywords
subject: Statistical Sampling
  topic: keywords
subject: Large-Scale Data Processing
  topic: keywords
creator: Carlos Mendes
rights: Copyright (c) 2023
date: 2023-07-03
publication date: 2023-07-03
starting page: 01
ending page: 17
doi: 10.67228/3142788X/IJMLPA-2023PII3Q7V

Interpretable Machine Learning Models for Critical Decision Systems
type: item
description: Machine learning (ML) systems are finding more and more applications in high-reliability decision-making setting including medical diagnosis, risk estimation in the finance sector, driverless transport, law enforcement, and fault management in industries. Their lack of transparency makes complex black-box models, especially deep neural networks and ensemble learning methods, highly problematic in safety-critical and high-stakes application areas despite having shown impressive predictive accuracy. The regulatory requirement, ethical concerns, accountability and trust among users enforce that the decisions made by ML systems must be interpretable, clarifiable and verifiable. That caused the increased attention to the area of interpretable machine learning (IML), which is supposed to reconcile predictive score and interpretable reasoning available to humans. This paper is the systematic and complete study of interpretable machine learning models of critical decision systems. We start by examining the conceptual basis behind interpretability and its significance in high risk applications. An elaborate literature review classifies the currently existing interpretability methods as intrinsic interpretability methods and post-hoc explanation methods and their strong and weak points and the appropriateness to critical systems. The suggested methodology describes a systematic approach to the selection, design and validation of interpretable ML models within real-life conditions of uncertainties of data, bias and regulatory standards. Mathematically stated representative interpretable models such as linear models, decision trees, rule-based systems and attention mechanisms are given to provide formal grounding. Examples of experimental findings of representative domains of application are presented to illustrate the trade-offs in interpretability and performance. The discussion highlights levels of interpretability, robustness, and fairness measures, and predictive accuracy.…
subject: Articles
  topic: section
subject: Interpretable Machine Learning
  topic: keywords
subject: Explainable AI
  topic: keywords
subject: Critical Decision Systems
  topic: keywords
subject: Model Transparency
  topic: keywords
subject: Trustworthy AI
  topic: keywords
subject: Fairness
  topic: keywords
subject: Accountability
  topic: keywords
subject: Safety-Critical Applications
  topic: keywords
creator: Amanda Davis
rights: Copyright (c) 2023
date: 2023-05-05
publication date: 2023-05-05
starting page: 01
ending page: 12
doi: 10.67228/3142788X/IJMLPA-2023PI9W2R

Ensemble Learning Techniques for Enhanced Classification Accuracy
type: item
description: Ensemble learning is a powerful machine learning approach that improves classification performance by combining multiple models rather than relying on a single one. By leveraging model diversity, it reduces bias, variance, and generalization error, making it effective across various applications. This paper reviews key ensemble techniques such as bagging, boosting, and stacking, along with hybrid approaches that integrate models like decision trees, support vector machines, neural networks, and probabilistic classifiers. It explains how diversity, aggregation methods, and error decomposition contribute to improved results. A structured methodology is presented, covering data preprocessing, base model selection, ensemble construction, and evaluation. Mathematical formulations for voting, weighted aggregation, and loss minimization are also discussed. Empirical results show that ensemble models outperform single classifiers in accuracy, precision, recall, F1-score, and robustness to noise. Boosting performs better on imbalanced datasets, while bagging is more stable in high-variance scenarios. Overall, ensemble learning is a flexible and scalable solution for complex classification tasks such as medical diagnosis, intrusion detection, financial analysis, and image recognition. The paper concludes by highlighting challenges like computational cost and lack of interpretability, and suggests future research in explainable and adaptive ensemble systems.
subject: Articles
  topic: section
subject: Ensemble Learning
  topic: keywords
subject: Classification Accuracy
  topic: keywords
subject: Bagging
  topic: keywords
subject: Boosting
  topic: keywords
subject: Stacking
  topic: keywords
subject: Machine Learning
  topic: keywords
subject: Model Diversity
  topic: keywords
subject: Predictive Analytics
  topic: keywords
creator: Daniel Moore
rights: Copyright (c) 2023
date: 2023-02-03
publication date: 2023-02-03
starting page: 01
ending page: 14
doi: 10.67228/3142788X/IJMLPA-2023PI7K4D

Semi-Supervised Learning for Data-Scarce Environments
type: item
description: In most practical machine learning systems, it is costly, time-consuming, and the process of obtaining labeled data is even impractical in certain areas like the medical field, remote sensing, cyber security and industrial automation, among others. Nonetheless, large volumes of raw data are usually easy to find. Semi-supervised learning (SSL) has become an impressive paradigm that applies both labeled and unlabeled data to enhance the learning performance in situations with scarce data. In this paper, we discuss a detailed research on semi-supervised learning methods in data-sparse setting and their theoretical basis, algorithm details and deployment strategies. We consider classical and deep learning-based methods of SSL, such as self-training, co-training, graph based, consistency regularization and pseudo-labeling. An integrated deployment approach is suggested regarding the implementation of the SSL systems in practice, where there are data constraints. The effectiveness of SSL methods in comparison to the completely supervised models is proved by a lot of experimental analysis and comparative evaluation. The findings show that semi-supervised learning provides significant improvement in accuracy of classification, robustness and generalization and also minimizes cost of annotation. The paper is concluded by the insights about the open research challenges and the further directions.
subject: Articles
  topic: section
subject: Semi-Supervised Learning
  topic: keywords
subject: Data-Scarce Environments
  topic: keywords
subject: Machine Learning
  topic: keywords
subject: Self-Training
  topic: keywords
subject: Pseudo-Labeling
  topic: keywords
subject: Consistency Regularization
  topic: keywords
subject: Deep Learning
  topic: keywords
subject: Unlabeled Data
  topic: keywords
creator: Ali Reza
rights: Copyright (c) 2023
date: 2023-06-04
publication date: 2023-06-04
starting page: 01
ending page: 15
doi: 10.67228/3142788X/IJMLPA-2023PI4N7T

A Comparative Study of Supervised Learning Algorithms for High-Dimensional Data
type: item
description: High-dimensional data are now ubiquitous in the modern science and industry, such as bioinformatics, text mining, computer vision, finance, and cybersecurity. A prominent feature of such data is having many features in comparison with the number of observations, which may cause the judgement problem of the curse of dimensionality, greater computational cost, feature overlap, and overfitting. Though supervised learning algorithms are extensively used to do predictive modeling, they have very different performance properties in high dimensional feature space. The paper contains a thorough comparison of some of the most popular supervised learning algorithms in the high-dimensional data analysis scenario. The paper provides a systematic comparison between the linear, non-linear, probabilistic, and ensemble-based classifiers, which are: Logistic Regression, Support Vector Machine, k -Nearest Neighbor, Decision Tree, Random Forest, Naive Bayes, and Artificial Neural Network. Special attention is given to the study of the behaviour of an algorithm based on scalability, ability to generalize, resistance to noise, feature sparsity, and interpretability. Besides, the paper explores how dimensionality reduction and feature selection methods impact on the performance of classification. It suggests a single experimental procedure with standardized preprocessing pipelines, cross-validation schemes and performance metrics accuracy, precision, recall, F1-score and cost of the computation. To give the concept theoretical background, mathematical formulations of learning objectives and decision functions are given. The comparative analysis indicates that there is no universal algorithm that has the best performance in all high-dimensional conditions; the performance highly depends on the sample size, the features correlation, the level of data distribution as well as noise. This study has practical implications on researchers and practitioners to consider the proper supervised learn…
subject: Articles
  topic: section
subject: High-Dimensional Data
  topic: keywords
subject: Supervised Learning
  topic: keywords
subject: Classification Algorithms
  topic: keywords
subject: Feature Selection
  topic: keywords
subject: Curse Of Dimensionality
  topic: keywords
subject: Machine Learning Evaluation
  topic: keywords
creator: Sanjay Verma
creator: Naveen Kumar
rights: Copyright (c) 2023
date: 2023-01-02
publication date: 2023-01-02
starting page: 01
ending page: 14
doi: 10.67228/3142788X/IJMLPA-2023PI3R7H

Improved Gradient Descent Optimization Using Adaptive Step-Sizing
type: item
description: Gradient Descent (GD) is among the classic and most common optimization algorithms in machine learning, signal processing and numerical optimization. Although conceptually appealing and simple, traditional gradient descent with a constant learning rate is prone to slow convergence, oscillation or divergence, particularly in high-dimensional non-convex or ill-conditioned optimization problems. The choice of a suitable size of steps (learning rate) is also a critical issue since the progressively small step sizes results in very sluggish convergence, and conversely, the large step size can overshoot the minima. This paper describes a creation of a better gradient descent based on adaptive step-sizing, which varies the learning rate at each training step based on the gradient tendencies and previous update data. The suggested methodology will be designed to make convergence faster, achieve better numerical stability, and have more robustness in a broad longitude of optimization problems. We present a complete formulation of theory, the design of algorithms and their comparison with classical gradient descent and other popular adaptive versions. The presence of extensive experiments on benchmarks of optimization functions and machine learning tasks demonstrate that adaptive step-sizing has a substantial positive effect both on the rate of convergence and the quality of the solution and on the sensitivity to hyper parameter++ starting point. The findings prove that when used in contemporary optimization problems with large scale, adaptive gradient descent techniques are feasible and scaled to large scale problems. The contribution of this work is a framework that is well structured and can be easily incorporated into the existing learning systems and optimization pipelines.
subject: Articles
  topic: section
subject: Gradient Descent
  topic: keywords
subject: Adaptive Learning Rate
  topic: keywords
subject: Step-Size Optimization
  topic: keywords
subject: Convex Optimization
  topic: keywords
subject: Machine Learning Optimization
  topic: keywords
creator: Divya Sharma
creator: Vikram Sethi
rights: Copyright (c) 2023
date: 2023-04-05
publication date: 2023-04-05
starting page: 01
ending page: 13
doi: 10.67228/3142788X/IJMLPA-2023PI1B8Q