Search Results for author: Konstantinos N. Plataniotis

Found 68 papers, 30 papers with code

The Need for Speed: Pruning Transformers with One Recipe

1 code implementation26 Mar 2024 Samir Khaki, Konstantinos N. Plataniotis

We introduce the $\textbf{O}$ne-shot $\textbf{P}$runing $\textbf{T}$echnique for $\textbf{I}$nterchangeable $\textbf{N}$etworks ($\textbf{OPTIN}$) framework as a tool to increase the efficiency of pre-trained transformer architectures $\textit{without requiring re-training}$.

Image Classification Semantic Segmentation +1

Comp4D: LLM-Guided Compositional 4D Scene Generation

no code implementations25 Mar 2024 Dejia Xu, Hanwen Liang, Neel P. Bhatt, Hezhen Hu, Hanxue Liang, Konstantinos N. Plataniotis, Zhangyang Wang

Recent advancements in diffusion models for 2D and 3D content creation have sparked a surge of interest in generating 4D content.

Object Scene Generation +1

NYCTALE: Neuro-Evidence Transformer for Adaptive and Personalized Lung Nodule Invasiveness Prediction

no code implementations15 Feb 2024 Sadaf Khademi, Anastasia Oikonomou, Konstantinos N. Plataniotis, Arash Mohammadi

Distinct from conventional Computed Tomography (CT)-based Deep Learning (DL) models, the NYCTALE performs predictions only when sufficient amount of evidence is accumulated.

Computed Tomography (CT) Lung Cancer Diagnosis

A unified uncertainty-aware exploration: Combining epistemic and aleatory uncertainty

no code implementations5 Jan 2024 Parvin Malekzadeh, Ming Hou, Konstantinos N. Plataniotis

In this paper, we propose an algorithm that clarifies the theoretical connection between aleatory and epistemic uncertainty, unifies aleatory and epistemic uncertainty estimation, and quantifies the combined effect of both uncertainties for a risk-sensitive exploration.

Decision Making Reinforcement Learning (RL)

A Robust Quantile Huber Loss With Interpretable Parameter Adjustment In Distributional Reinforcement Learning

1 code implementation4 Jan 2024 Parvin Malekzadeh, Konstantinos N. Plataniotis, Zissis Poulos, Zeyu Wang

Distributional Reinforcement Learning (RL) estimates return distribution mainly by learning quantile values via minimizing the quantile Huber loss function, entailing a threshold parameter often selected heuristically or via hyperparameter search, which may not generalize well and can be suboptimal.

Atari Games Distributional Reinforcement Learning +1

Test-Time Domain Adaptation by Learning Domain-Aware Batch Normalization

1 code implementation15 Dec 2023 Yanan Wu, Zhixiang Chi, Yang Wang, Konstantinos N. Plataniotis, Songhe Feng

In this work, we propose to reduce such learning interference and elevate the domain knowledge learning by only manipulating the BN layer.

Domain Adaptation Meta-Learning +1

Uncertainty-aware transfer across tasks using hybrid model-based successor feature reinforcement learning

no code implementations16 Oct 2023 Parvin Malekzadeh, Ming Hou, Konstantinos N. Plataniotis

Putting together two ideas of hybrid model-based successor feature (MB-SF) and uncertainty leads to an approach to the problem of sample efficient uncertainty-aware knowledge transfer across tasks with different transition dynamics or/and reward functions.

Decision Making Reinforcement Learning (RL) +1

DataDAM: Efficient Dataset Distillation with Attention Matching

2 code implementations ICCV 2023 Ahmad Sajedi, Samir Khaki, Ehsan Amjadian, Lucy Z. Liu, Yuri A. Lawryshyn, Konstantinos N. Plataniotis

Emerging research on dataset distillation aims to reduce training costs by creating a small synthetic set that contains the information of a larger real dataset and ultimately achieves test accuracy equivalent to a model trained on the whole dataset.

Continual Learning Neural Architecture Search

CLSA: Contrastive Learning-based Survival Analysis for Popularity Prediction in MEC Networks

no code implementations21 Mar 2023 Zohreh Hajiakhondi-Meybodi, Arash Mohammadi, Jamshid Abouei, Konstantinos N. Plataniotis

Mobile Edge Caching (MEC) integrated with Deep Neural Networks (DNNs) is an innovative technology with significant potential for the future generation of wireless networks, resulting in a considerable reduction in users' latency.

Contrastive Learning Survival Analysis

Pseudo-Inverted Bottleneck Convolution for DARTS Search Space

1 code implementation31 Dec 2022 Arash Ahmadian, Louis S. P. Liu, Yue Fei, Konstantinos N. Plataniotis, Mahdi S. Hosseini

Our proposed architecture is much less sensitive to evaluation layer count and outperforms a DARTS network with similar size significantly, at layer counts as small as 2.

Neural Architecture Search

Graph Federated Learning for CIoT Devices in Smart Home Applications

1 code implementation29 Dec 2022 Arash Rasti-Meymandi, Seyed Mohammad Sheikholeslami, Jamshid Abouei, Konstantinos N. Plataniotis

This paper deals with the problem of statistical and system heterogeneity in a cross-silo Federated Learning (FL) framework where there exist a limited number of Consumer Internet of Things (CIoT) devices in a smart building.

Federated Learning Scheduling

ViT-CAT: Parallel Vision Transformers with Cross Attention Fusion for Popularity Prediction in MEC Networks

no code implementations27 Oct 2022 Zohreh Hajiakhondi-Meybodi, Arash Mohammadi, Ming Hou, Jamshid Abouei, Konstantinos N. Plataniotis

Followed by a Cross Attention (CA) module as the Fusion Center (FC), the proposed ViT-CAT is capable of learning the mutual information between temporal and spatial correlations, as well, resulting in improving the classification accuracy, and decreasing the model's complexity about 8 times.

Time Series Analysis

Subclass Knowledge Distillation with Known Subclass Labels

no code implementations17 Jul 2022 Ahmad Sajedi, Yuri A. Lawryshyn, Konstantinos N. Plataniotis

In classification tasks with a small number of classes or binary detection, the amount of information transferred from the teacher to the student is restricted, thus limiting the utility of knowledge distillation.

Binary Classification Knowledge Distillation

A Kernel Method to Nonlinear Location Estimation with RSS-based Fingerprint

no code implementations7 Apr 2022 Pai Chet Ng, Petros Spachos, James She, Konstantinos N. Plataniotis

Given the fingerprint observed by the smartphone, the user's current location can be estimated by finding the top-k similar fingerprints from the list of fingerprints registered in the database.

AKF-SR: Adaptive Kalman Filtering-based Successor Representation

no code implementations31 Mar 2022 Parvin Malekzadeh, Mohammad Salimibeni, Ming Hou, Arash Mohammadi, Konstantinos N. Plataniotis

Recent studies in neuroscience suggest that Successor Representation (SR)-based models provide adaptation to changes in the goal locations or reward function faster than model-free algorithms, together with lower computational cost compared to that of model-based algorithms.

Active Learning Decision Making

Exploiting Explainable Metrics for Augmented SGD

2 code implementations CVPR 2022 Mahdi S. Hosseini, Mathieu Tuli, Konstantinos N. Plataniotis

In this paper, we address the following question: \textit{can we probe intermediate layers of a deep neural network to identify and quantify the learning quality of each layer?}

Stochastic Optimization

HistoKT: Cross Knowledge Transfer in Computational Pathology

1 code implementation27 Jan 2022 Ryan Zhang, Jiadai Zhu, Stephen Yang, Mahdi S. Hosseini, Angelo Genovese, Lina Chen, Corwyn Rowsell, Savvas Damaskinos, Sonal Varma, Konstantinos N. Plataniotis

In this paper, we take a data-centric approach to the transfer learning problem and examine the existence of generalizable knowledge between histopathological datasets.

Transfer Learning

Multi-Agent Reinforcement Learning via Adaptive Kalman Temporal Difference and Successor Representation

no code implementations30 Dec 2021 Mohammad Salimibeni, Arash Mohammadi, Parvin Malekzadeh, Konstantinos N. Plataniotis

The proposed MAK-TD/SR frameworks consider the continuous nature of the action-space that is associated with high dimensional multi-agent environments and exploit Kalman Temporal Difference (KTD) to address the parameter uncertainty.

Multi-agent Reinforcement Learning OpenAI Gym +2

TEDGE-Caching: Transformer-based Edge Caching Towards 6G Networks

no code implementations1 Dec 2021 Zohreh Hajiakhondi Meybodi, Arash Mohammadi, Elahe Rahimian, Shahin Heidarian, Jamshid Abouei, Konstantinos N. Plataniotis

As a consequence of the COVID-19 pandemic, the demand for telecommunication for remote learning/working and telemedicine has significantly increased.

Towards Robust and Automatic Hyper-Parameter Tunning

1 code implementation28 Nov 2021 Mathieu Tuli, Mahdi S. Hosseini, Konstantinos N. Plataniotis

In this work, we introduce a new class of HPO method and explore how the low-rank factorization of the convolutional weights of intermediate layers of a convolutional neural network can be used to define an analytical response surface for optimizing hyper-parameters, using only training data.

Bayesian Optimization

P4AI: Approaching AI Ethics through Principlism

no code implementations28 Nov 2021 Andre Fu, Elisa Ding, Mahdi S. Hosseini, Konstantinos N. Plataniotis

The field of computer vision is rapidly evolving, particularly in the context of new methods of neural architecture design.

Ethics

In Search of Probeable Generalization Measures

1 code implementation23 Oct 2021 Jonathan Jaegerman, Khalil Damouni, Mahdi S. Hosseini, Konstantinos N. Plataniotis

Understanding the generalization behaviour of deep neural networks is a topic of recent interest that has driven the production of many studies, notably the development and evaluation of generalization "explainability" measures that quantify model generalization ability.

CAE-Transformer: Transformer-based Model to Predict Invasiveness of Lung Adenocarcinoma Subsolid Nodules from Non-thin Section 3D CT Scans

no code implementations17 Oct 2021 Shahin Heidarian, Parnian Afshar, Anastasia Oikonomou, Konstantinos N. Plataniotis, Arash Mohammadi

Lung cancer is the leading cause of mortality from cancer worldwide and has various histologic types, among which Lung Adenocarcinoma (LUAC) has recently been the most prevalent one.

Computed Tomography (CT) Specificity

CONetV2: Efficient Auto-Channel Size Optimization for CNNs

1 code implementation13 Oct 2021 Yi Ru Wang, Samir Khaki, Weihang Zheng, Mahdi S. Hosseini, Konstantinos N. Plataniotis

Neural Architecture Search (NAS) has been pivotal in finding optimal network configurations for Convolution Neural Networks (CNNs).

Knowledge Distillation Neural Architecture Search

Robust Framework for COVID-19 Identification from a Multicenter Dataset of Chest CT Scans

no code implementations19 Sep 2021 Sadaf Khademi, Shahin Heidarian, Parnian Afshar, Nastaran Enshaei, Farnoosh Naderkhani, Moezedin Javad Rafiee, Anastasia Oikonomou, Akbar Shafiee, Faranak Babaki Fard, Konstantinos N. Plataniotis, Arash Mohammadi

We showed that while our proposed model is trained on a relatively small dataset acquired from only one imaging center using a specific scanning protocol, the model performs well on heterogeneous test sets obtained by multiple scanners using different technical parameters.

On the Efficiency of Subclass Knowledge Distillation in Classification Tasks

no code implementations12 Sep 2021 Ahmad Sajedi, Konstantinos N. Plataniotis

These results show that the extra subclasses' knowledge (i. e., 0. 4656 label bits per training sample in our experiment) can provide more information about the teacher generalization, and therefore SKD can benefit from using more information to increase the student performance.

Binary Classification Classification +1

DQLEL: Deep Q-Learning for Energy-Optimized LoS/NLoS UWB Node Selection

no code implementations24 Aug 2021 Zohreh Hajiakhondi-Meybodi, Arash Mohammadi, Ming Hou, Konstantinos N. Plataniotis

Although UWB technology can enhance the accuracy of indoor positioning due to the use of a wide-frequency spectrum, there are key challenges ahead for its efficient implementation.

Q-Learning

Probeable DARTS with Application to Computational Pathology

1 code implementation16 Aug 2021 Sheyang Tang, Mahdi S. Hosseini, Lina Chen, Sonal Varma, Corwyn Rowsell, Savvas Damaskinos, Konstantinos N. Plataniotis, Zhou Wang

AI technology has made remarkable achievements in computational pathology (CPath), especially with the help of deep neural networks.

Neural Architecture Search

CONet: Channel Optimization for Convolutional Neural Networks

1 code implementation15 Aug 2021 Mahdi S. Hosseini, Jia Shu Zhang, Zhe Liu, Andre Fu, Jingxuan Su, Mathieu Tuli, Sepehr Hosseini, Arsh Kadakia, Haoran Wang, Konstantinos N. Plataniotis

To solve this, we introduce an efficient dynamic scaling algorithm -- CONet -- that automatically optimizes channel sizes across network layers for a given CNN.

Neural Architecture Search

COVID-Rate: An Automated Framework for Segmentation of COVID-19 Lesions from Chest CT Scans

no code implementations4 Jul 2021 Nastaran Enshaei, Anastasia Oikonomou, Moezedin Javad Rafiee, Parnian Afshar, Shahin Heidarian, Arash Mohammadi, Konstantinos N. Plataniotis, Farnoosh Naderkhani

In this context, first, the paper introduces an open access COVID-19 CT segmentation dataset containing 433 CT images from 82 patients that have been annotated by an expert radiologist.

Computed Tomography (CT) Specificity

Reconsidering CO2 emissions from Computer Vision

no code implementations18 Apr 2021 Andre Fu, Mahdi S. Hosseini, Konstantinos N. Plataniotis

To address these concerns, we propose adding "enforcement" as a pillar of ethical AI and provide some recommendations for how architecture designers and broader CV community can curb the climate crisis.

Integrated Grad-CAM: Sensitivity-Aware Visual Explanation of Deep Convolutional Networks via Integrated Gradient-Based Scoring

1 code implementation15 Feb 2021 Sam Sattarzadeh, Mahesh Sudhakar, Konstantinos N. Plataniotis, Jongseong Jang, Yeonjeong Jeong, Hyunwoo Kim

However, the average gradient-based terms deployed in this method underestimates the contribution of the representations discovered by the model to its predictions.

Object Localization

On the Philosophical, Cognitive and Mathematical Foundations of Symbiotic Autonomous Systems (SAS)

no code implementations11 Feb 2021 Yingxu Wang, Fakhri Karray, Sam Kwong, Konstantinos N. Plataniotis, Henry Leung, Ming Hou, Edward Tunstel, Imre J. Rudas, Ljiljana Trajkovic, Okyay Kaynak, Janusz Kacprzyk, Mengchu Zhou, Michael H. Smith, Philip Chen, Shushma Patel

Symbiotic Autonomous Systems (SAS) are advanced intelligent and cognitive systems exhibiting autonomous collective intelligence enabled by coherent symbiosis of human-machine interactions in hybrid societies.

Maximum Mutation Reinforcement Learning for Scalable Control

2 code implementations24 Jul 2020 Karush Suri, Xiao Qi Shi, Konstantinos N. Plataniotis, Yuri A. Lawryshyn

Advances in Reinforcement Learning (RL) have demonstrated data efficiency and optimal control over large state spaces at the cost of scalable performance.

reinforcement-learning Reinforcement Learning (RL)

Stain Style Transfer of Histopathology Images Via Structure-Preserved Generative Learning

1 code implementation24 Jul 2020 Hanwen Liang, Konstantinos N. Plataniotis, Xingyu Li

To address the issue of color variations in histopathology images, this study proposes two stain style transfer models, SSIM-GAN and DSCSI-GAN, based on the generative adversarial networks.

SSIM Style Transfer

All at Once: Temporally Adaptive Multi-Frame Interpolation with Advanced Motion Modeling

no code implementations ECCV 2020 Zhixiang Chi, Rasoul Mohammadi Nasiri, Zheng Liu, Juwei Lu, Jin Tang, Konstantinos N. Plataniotis

Recent advances in high refresh rate displays as well as the increased interest in high rate of slow motion and frame up-conversion fuel the demand for efficient and cost-effective multi-frame video interpolation solutions.

FocusLiteNN: High Efficiency Focus Quality Assessment for Digital Pathology

1 code implementation11 Jul 2020 Zhongling Wang, Mahdi S. Hosseini, Adyn Miles, Konstantinos N. Plataniotis, Zhou Wang

Out-of-focus microscopy lens in digital pathology is a critical bottleneck in high-throughput Whole Slide Image (WSI) scanning platforms, for which pixel-level automated Focus Quality Assessment (FQA) methods are highly desirable to help significantly accelerate the clinical workflows.

Vocal Bursts Intensity Prediction

AdaS: Adaptive Scheduling of Stochastic Gradients

2 code implementations11 Jun 2020 Mahdi S. Hosseini, Konstantinos N. Plataniotis

The choice of step-size used in Stochastic Gradient Descent (SGD) optimization is empirically selected in most training procedures.

Scheduling

MM-KTD: Multiple Model Kalman Temporal Differences for Reinforcement Learning

1 code implementation30 May 2020 Parvin Malekzadeh, Mohammad Salimibeni, Arash Mohammadi, Akbar Assa, Konstantinos N. Plataniotis

As a result, the proposed MM-KTD framework can learn the optimal policy with significantly reduced number of samples as compared to its DNN-based counterparts.

Active Learning reinforcement-learning +1

How Much Off-The-Shelf Knowledge Is Transferable From Natural Images To Pathology Images?

no code implementations24 Apr 2020 Xingyu Li, Konstantinos N. Plataniotis

Particularly, compared to the performance baseline obtained by random-weight model, though transferability of off-the-shelf representations from deep layers heavily depend on specific pathology image sets, the general representation generated by early layers does convey transferred knowledge in various image classification applications.

General Classification Image Classification +1

A Comprehensive Analysis of Weakly-Supervised Semantic Segmentation in Different Image Domains

1 code implementation24 Dec 2019 Lyndon Chan, Mahdi S. Hosseini, Konstantinos N. Plataniotis

Our experiments indicate that histopathology and satellite images present a different set of problems for weakly-supervised semantic segmentation than natural scene images, such as ambiguous boundaries and class co-occurrence.

Segmentation Weakly supervised Semantic Segmentation +1

Focus Quality Assessment of High-Throughput Whole Slide Imaging in Digital Pathology

1 code implementation14 Nov 2018 Mahdi S. Hosseini, Yueyang Zhang, Lyndon Chan, Konstantinos N. Plataniotis, Jasper A. Z. Brawley-Hayes, Savvas Damaskinos

We also extend our method to generate a local slide-level focus quality heatmap, which can be used for automated slide quality control, and demonstrate the utility of our method for clinical scan quality control by comparison with subjective slide quality scores.

Convolutional Deblurring for Natural Imaging

1 code implementation25 Oct 2018 Mahdi S. Hosseini, Konstantinos N. Plataniotis

In this paper, we propose a novel design of image deblurring in the form of one-shot convolution filtering that can directly convolve with naturally blurred images for restoration.

Deblurring Image Deblurring +2

From Hand-Crafted to Deep Learning-based Cancer Radiomics: Challenges and Opportunities

no code implementations23 Aug 2018 Parnian Afshar, Arash Mohammadi, Konstantinos N. Plataniotis, Anastasia Oikonomou, Habib Benali

Recent advancements in signal processing and machine learning coupled with developments of electronic medical record keeping in hospitals and the availability of extensive set of medical images through internal/external communication systems, have resulted in a recent surge of significant interest in "Radiomics".

Improved Explainability of Capsule Networks: Relevance Path by Agreement

no code implementations27 Feb 2018 Atefeh Shahroudnejad, Arash Mohammadi, Konstantinos N. Plataniotis

Recent advancements in signal processing and machine learning domains have resulted in an extensive surge of interest in deep learning models due to their unprecedented performance and high accuracy for different and challenging problems of significant engineering importance.

Explainable artificial intelligence Explainable Artificial Intelligence (XAI)

Brain Tumor Type Classification via Capsule Networks

no code implementations27 Feb 2018 Parnian Afshar, Arash Mohammadi, Konstantinos N. Plataniotis

Brain tumor is considered as one of the deadliest and most common form of cancer both in children and in adults.

Classification General Classification +1

High-Accuracy Total Variation for Compressed Video Sensing

no code implementations1 Sep 2013 Mahdi S. Hosseini, Konstantinos N. Plataniotis

Numerous total variation (TV) regularizers, engaged in image restoration problem, encode the gradients by means of simple $[-1, 1]$ FIR filter.

Image Restoration Vocal Bursts Intensity Prediction

Cannot find the paper you are looking for? You can Submit a new open access paper.