- 标题
- 摘要
- 关键词
- 实验方案
- 产品
-
Cloud removal in remote sensing images using nonnegative matrix factorization and error correction
摘要: In the imaging process of optical remote sensing platforms, clouds are an inevitable barrier to the effective observation of sensors. To recover the original information covered by the clouds and the accompanying shadows, a nonnegative matrix factorization (NMF) and error correction method (S-NMF-EC) is proposed in this paper. Firstly, a cloud-free fused reference image is obtained by a reference image and two or more low-resolution images using the spatial and temporal nonlocal filter-based data fusion model (STNLFFM). Secondly, the cloud-free fused reference image is used to remove the cloud cover of the cloud-contaminated image based on NMF. Finally, the cloud removal result is further improved by error correction. It is worth noting that cloud detection is not required by S-NMF-EC, and the cloud-free information of the cloud-contaminated image is maximally retained. Both simulated and real-data experiments were conducted to validate the proposed S-NMF-EC method. Compared with other cloud removal methods, the results demonstrate that S-NMF-EC is visually and quantitatively effective (correlation coefficients ≥ 0.99) for the removal of thick clouds, thin clouds, and shadows.
关键词: Nonnegative matrix factorization,Multitemporal,Optical remote sensing image,Error correction,Cloud removal
更新于2025-09-23 15:23:52
-
[IEEE 2018 IEEE 3rd International Conference on Signal and Image Processing (ICSIP) - Shenzhen, China (2018.7.13-2018.7.15)] 2018 IEEE 3rd International Conference on Signal and Image Processing (ICSIP) - Robust Nonnegative Local Coordinate Factorization for Hyperspectral Unmixing
摘要: Recently, nonnegative matrix factorization (NMF) has become increasingly popular for hyperspectral unmixing (HU). Due to the non-convex nature of the NMF theory, which is sensitive to the initial value and various noise. To obtain more accurate and robust unmixing model, in this paper, we propose a novel method called robust nonnegative local coordinate factorization (RNLCF). RNLCF adds a local coordinate constraint into the composite loss function which combing classic and Correntropy Induced Metric NMF function. To solve RNLCF, we developed a multiplicative update rules. Experimental results on synthetic and real-world data verify the effectiveness of RNLCF comparing with the representative methods.
关键词: local coordinate,Correntropy Induced Metric,hyperspectral unmixing (HU),nonnegative matrix factorization (NMF)
更新于2025-09-23 15:22:29
-
[IEEE IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium - Valencia (2018.7.22-2018.7.27)] IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium - Blind Nonlinear Hyperspectral Unmixing Using an <tex>$\ell_{q}$</tex> Regularizer
摘要: Hyperspectral unmixing consists of estimating pure material spectra (endmembers) and their corresponding abundances in hyperspectral images. In this paper, a blind nonlinear hyperspectral unmixing algorithm is presented. The algorithm promotes sparse abundance maps using an lq regularizer and assumes that the spectra are mixed according to an extension to generalized bilinear model, called the Fan model. The algorithm is evaluated using both simulated and real hyperspectral data.
关键词: non-negative matrix factorization,Spectral unmixing,bilinear model,hyperspectral images
更新于2025-09-23 15:22:29
-
Nonconvex-sparsity and Nonlocal-smoothness Based Blind Hyperspectral Unmixing
摘要: Blind hyperspectral unmixing (HU), as a crucial technique for hyperspectral data exploitation, aims to decompose mixed pixels into a collection of constituent materials weighted by the corresponding fractional abundances. In recent years, nonnegative matrix factorization (NMF) based methods have become more and more popular for this task and achieved promising performance. Among these methods, two types of properties upon the abundances, namely the sparseness and the structural smoothness, have been explored and shown to be important for blind HU. However, all of previous methods ignores another important insightful property possessed by a natural hyperspectral images (HSI), non-local smoothness, which means that similar patches in a larger region of an HSI are sharing the similar smoothness structure. Based on previous attempts on other tasks, such a prior structure reflects intrinsic configurations underlying a HSI, and is thus expected to largely improve the performance of the investigated HU problem. In this paper, we firstly consider such prior in HSI by encoding it as the non-local total variation (NLTV) regularizer. Furthermore, by fully exploring the intrinsic structure of HSI, we generalize NLTV to non-local HSI TV (NLHTV) to make the model more suitable for the bind HU task. By incorporating these two regularizers, together with a non-convex log-sum form regularizer characterizing the sparseness of abundance maps, to the NMF model, we propose novel blind HU models named NLTV/NLHTV and log-sum regularized NMF (NLTV-LSRNMF/NLHTV-LSRNMF), respectively. To solve the proposed models, an efficient algorithm is designed based on alternative optimization strategy (AOS) and alternating direction method of multipliers (ADMM). Extensive experiments conducted on both simulated and real hyperspectral data sets substantiate the superiority of the proposed approach over other competing ones for blind HU task.
关键词: log-sum penalty,non-negative matrix factorization,non-local total variation regularization,blind unmixing,Hyperspectral imaging
更新于2025-09-23 15:22:29
-
Supervised Non-negative Matrix Factorization Methods for MALDI Imaging Applications
摘要: Motivation: Non-negative matrix factorization (NMF) is a common tool for obtaining low-rank approximations of non-negative data matrices and has been widely used in machine learning, e.g., for supporting feature extraction in high-dimensional classification tasks. In its classical form NMF is an unsupervised method, i.e. the class labels of the training data are not used when computing the NMF. However, incorporating the classification labels into the NMF algorithms allows to specifically guide them towards the extraction of data patterns relevant for discriminating the respective classes. This approach is particularly suited for the analysis of mass spectrometry imaging (MSI) data in clinical applications, such as tumor typing and classification, which are amongst the most challenging tasks in pathology. Thus, we investigate algorithms for extracting tumor specific spectral patterns from MSI data by NMF methods. Results: In this paper, we incorporate a priori class labels into the NMF cost functional by adding appropriate supervised penalty terms. Numerical experiments on a MALDI imaging dataset confirm that the novel supervised NMF methods lead to significantly better classification accuracy and stability as compared to other standard approaches.
关键词: MALDI imaging,tumor typing,Non-negative matrix factorization,mass spectrometry imaging,supervised learning
更新于2025-09-23 15:21:01
-
[IEEE 2019 IEEE 8th International Conference on Advanced Optoelectronics and Lasers (CAOL) - Sozopol, Bulgaria (2019.9.6-2019.9.8)] 2019 IEEE 8th International Conference on Advanced Optoelectronics and Lasers (CAOL) - Wide-aperture deformable mirrors for wavefront distortions compensation in high-power laser complexes
摘要: This paper addresses the determined blind source separation problem and proposes a new effective method unifying independent vector analysis (IVA) and nonnegative matrix factorization (NMF). IVA is a state-of-the-art technique that utilizes the statistical independence between sources in a mixture signal, and an efficient optimization scheme has been proposed for IVA. However, since the source model in IVA is based on a spherical multivariate distribution, IVA cannot utilize specific spectral structures such as the harmonic structures of pitched instrumental sounds. To solve this problem, we introduce NMF decomposition as the source model in IVA to capture the spectral structures. The formulation of the proposed method is derived from conventional multichannel NMF (MNMF), which reveals the relationship between MNMF and IVA. The proposed method can be optimized by the update rules of IVA and single-channel NMF. Experimental results show the efficacy of the proposed method compared with IVA and MNMF in terms of separation accuracy and convergence speed.
关键词: determined,independent vector analysis,Blind source separation,nonnegative matrix factorization
更新于2025-09-23 15:19:57
-
[IEEE 2019 Conference on Lasers and Electro-Optics Europe & European Quantum Electronics Conference (CLEO/Europe-EQEC) - Munich, Germany (2019.6.23-2019.6.27)] 2019 Conference on Lasers and Electro-Optics Europe & European Quantum Electronics Conference (CLEO/Europe-EQEC) - Systematic Design of Photonic Crystal Cavities with Ultra-Low Modal Volume Considering Different Fabrication Resolutions
摘要: Sparsity of the ratings available in the recommender system database makes the task of rating prediction a highly underdetermined problem. This poses a limit on the accuracy and the quality of prediction. In this paper, we utilize secondary information pertaining to user’s demography and item categories to enhance prediction accuracy. Within the matrix factorization framework, we introduce additional supervised label consistency terms that match the user and item factor matrices to the available secondary information (metadata). Matrix factorization model—conventionally employed in collaborative ?ltering techniques—yields dense user and dense item factor matrices—the assumption is that users have an af?nity toward all latent factors and items possess all latent factors. Our formulation, based on a recent work, aims to recover a dense user and a sparse item factor matrix—this is a more reasonable model. Human beings show a natural interest toward all the factors, but every item cannot possess all the factors; this leads to a sparse item factor matrix. A natural outcome of our proposal is a solution to the pure cold start problem. We utilize the label consistency map generated from the proposed model to make reasonable recommendations for new users and new items which have not (been) rated yet. We demonstrate the performance of our model for a movie recommendation system. We also design an ef?cient algorithm for our formulation.
关键词: cold start,blind compressive sensing,matrix factorization,latent factor model,Auxiliary information
更新于2025-09-23 15:19:57
-
Bayesian Electromagnetic Spatio-Temporal Imaging of Extended Sources based on Matrix Factorization
摘要: Accurate estimation of the locations and extents of neural sources from electroencephalography and magnetoencephalography (E/MEG) is challenging, especially for deep and highly correlated neural activities. In this study, we proposed a new fully data-driven source imaging method, Source Imaging based on Spatio-Temporal Basis Functions (SI-STBF), which is built upon a Bayesian framework, to address this issue. SI-STBF is based on the factorization of source matrix as a product of a sparse coding matrix and a temporal basis functions (TBFs) matrix which includes a few TBFs. The prior of TBF is set in the empirical Bayesian manner. Similarly, for the spatial constraint, SI-STBF assumes the prior covariance of the coding matrix as a weighted sum of several spatial covariance components. Both the TBFs and coding matrix are learned from E/MEG simultaneously through variational Bayesian inference. To enable inference on high-resolution source space, we derived a scalable algorithm using convex analysis. The performance of SI-STBF was assessed using both simulated and experimental E/MEG recordings. Compared with L2-norm constrained methods, SI-STBF is superior in reconstructing extended sources with less spatial diffusion and less localization error. By virtue of the spatio-temporal factorization of source matrix, SI-STBF also produces more accurate estimations than spatial-only constraint method for high correlated and deep sources.
关键词: Variational Bayesian Inference,Empirical Bayesian,EEG/MEG Source Imaging,Matrix Factorization
更新于2025-09-19 17:15:36
-
[IEEE 2019 PhotonIcs & Electromagnetics Research Symposium - Spring (PIERS-Spring) - Rome, Italy (2019.6.17-2019.6.20)] 2019 PhotonIcs & Electromagnetics Research Symposium - Spring (PIERS-Spring) - Resonance of the Annihilation Channel of a Laser-Assisted Electron-Positron Scattering
摘要: Data missing in collections of time series occurs frequently in practical applications and turns out to be a major menace to precise data analysis. However, most of the existing methods either might be infeasible or could be inefficient to predict the missing values in large-scale coevolving time series. Also, the evolving of time series needs to be handled properly to adapt to the temporal characteristic. Furthermore, more massive volume of data is generated in many areas than ever before. In this paper, we have taken up the challenge of missing data prediction in coevolving time series by employing temporal dynamic matrix factorization techniques. First, our approaches are optimally designed to largely utilize both the interior patterns of each time series and the information of time series across multiple sources to build an initial model. Based on the idea, we have imposed hybrid regularization terms to constrain the objective functions of matrix factorization. Then, temporal dynamic matrix factorization is proposed to effectively update the initial already trained models. In the process of dynamic matrix factorization, batch updating and fine-tuning strategies are also employed to build an effective and efficient model. Extensive experiments on real-world data sets and synthetic data set demonstrate that the proposed approaches can effectively improve the performance of missing data prediction. Even when the missing ratio reaches as high as 90%, our proposed methods still show low prediction errors. Dynamic performance demonstrates that the methods can obtain satisfactory effectiveness and efficiency. Furthermore, we have also demonstrated how to take advantage of the high processing power of Apache Spark to perform missing data prediction in large-scale coevolving time series.
关键词: time series,missing data prediction,Apache Spark,Matrix factorization
更新于2025-09-19 17:13:59
-
[IEEE 2019 Conference on Lasers and Electro-Optics Europe & European Quantum Electronics Conference (CLEO/Europe-EQEC) - Munich, Germany (2019.6.23-2019.6.27)] 2019 Conference on Lasers and Electro-Optics Europe & European Quantum Electronics Conference (CLEO/Europe-EQEC) - Generating Maximal Entanglement between Spectrally Distinct Solid-State Emitters
摘要: Data missing in collections of time series occurs frequently in practical applications and turns out to be a major menace to precise data analysis. However, most of the existing methods either might be infeasible or could be inefficient to predict the missing values in large-scale coevolving time series. Also, the evolving of time series needs to be handled properly to adapt to the temporal characteristic. Furthermore, more massive volume of data is generated in many areas than ever before. In this paper, we have taken up the challenge of missing data prediction in coevolving time series by employing temporal dynamic matrix factorization techniques. First, our approaches are optimally designed to largely utilize both the interior patterns of each time series and the information of time series across multiple sources to build an initial model. Based on the idea, we have imposed hybrid regularization terms to constrain the objective functions of matrix factorization. Then, temporal dynamic matrix factorization is proposed to effectively update the initial already trained models. In the process of dynamic matrix factorization, batch updating and fine-tuning strategies are also employed to build an effective and efficient model. Extensive experiments on real-world data sets and synthetic data set demonstrate that the proposed approaches can effectively improve the performance of missing data prediction. Even when the missing ratio reaches as high as 90%, our proposed methods still show low prediction errors. Dynamic performance demonstrates that the methods can obtain satisfactory effectiveness and efficiency. Furthermore, we have also demonstrated how to take advantage of the high processing power of Apache Spark to perform missing data prediction in large-scale coevolving time series.
关键词: missing data prediction,time series,Apache Spark,Matrix factorization
更新于2025-09-19 17:13:59