RECORD
Cross-Modal Virtual Sensing for Combustion Instability Monitoring
Machine Learning · Submitted 4 Oct 2021
abstract compiled · 2026-09-23 · no language-model review
The authors' main claim With the "distillation" of cross-modal features, the results demonstrate that the detection accuracy can be enhanced using the virtual visual sensing modality.
The compiled record
The paper's own sentences, arranged. Each label is drawn from a closed vocabulary; the number beside it is the probability the classifier gave that label. Numbers in the tables are the authors', checked by code. No sentence in this record was written by a model.
Open the compiled record
The abstract, sentence by sentence
In many cyber-physical systems, imaging can be an important but expensive or 'difficult to deploy' sensing modality. One such example is detecting combustion instability using flame images, where deep learning frameworks have demonstrated state-of-the-art performance. The proposed frameworks are also shown to be quite trustworthy such that domain experts can have sufficient confidence to use these models in real systems to prevent unwanted incidents. However, flame imaging is not a common sensing modality in engine combustors today. Therefore, the current roadblock exists on the hardware side regarding the acquisition and processing of high-volume flame images. On the other hand, the acoustic pressure time series is a more feasible modality for data collection in real combustors. To utilize acoustic time series as a sensing modality, we propose a novel cross-modal encoder-decoder architecture that can reconstruct cross-modal visual features from acoustic pressure time series in combustion systems. With the "distillation" of cross-modal features, the results demonstrate that the detection accuracy can be enhanced using the virtual visual sensing modality. By providing the benefit of cross-modal reconstruction, our framework can prove to be useful in different domains well beyond the power generation and transportation industries.
background contribution method result interpretation main claim
| # | sentence | role | the authors' own work | states the main conclusion | strength |
|---|---|---|---|---|---|
| s0 | In many cyber-physical systems, imaging can be an important but expensive or 'difficult to deploy' sensing modality. | background 1.00 | 0.05 | 0.02 | asserted 0.72 |
| s1 | One such example is detecting combustion instability using flame images, where deep learning frameworks have demonstrated state-of-the-art performance. | background 1.00 | 0.10 | 0.04 | asserted 1.00 |
| s2 | The proposed frameworks are also shown to be quite trustworthy such that domain experts can have sufficient confidence to use these models in real systems to prevent unwanted incidents. | interpretation 0.57 | 0.56 | 0.10 | asserted 0.99 |
| s3 | However, flame imaging is not a common sensing modality in engine combustors today. | background 0.65 | 0.11 | 0.02 | asserted 1.00 |
| s4 | Therefore, the current roadblock exists on the hardware side regarding the acquisition and processing of high-volume flame images. | gap 0.64 | 0.16 | 0.04 | asserted 1.00 |
| s5 | On the other hand, the acoustic pressure time series is a more feasible modality for data collection in real combustors. | background 0.97 | 0.12 | 0.04 | asserted 1.00 |
| s6 | To utilize acoustic time series as a sensing modality, we propose a novel cross-modal encoder-decoder architecture that can reconstruct cross-modal visual features from acoustic pressure time series in combustion systems. | method 0.50 | 0.83 | 0.15 | asserted 0.89 |
| s7 | With the "distillation" of cross-modal features, the results demonstrate that the detection accuracy can be enhanced using the virtual visual sensing modality. | result 0.99 | 0.89 | 0.49 | asserted 0.99 |
| s8 | By providing the benefit of cross-modal reconstruction, our framework can prove to be useful in different domains well beyond the power generation and transportation industries. | interpretation 0.93 | 0.22 | 0.16 | asserted 0.74 |
What was examined, and what was not
- arXiv listing abstract v2
- full text
- figures and tables
- references and citing sentences
- relations to other papers
- P abstract
- S sections
- T body sentences
- C citations
- R cross-paper relations
The paper
Original abstract
In many cyber-physical systems, imaging can be an important but expensive or 'difficult to deploy' sensing modality. One such example is detecting combustion instability using flame images, where deep learning frameworks have demonstrated state-of-the-art performance. The proposed frameworks are also shown to be quite trustworthy such that domain experts can have sufficient confidence to use these models in real systems to prevent unwanted incidents. However, flame imaging is not a common sensing modality in engine combustors today. Therefore, the current roadblock exists on the hardware side regarding the acquisition and processing of high-volume flame images. On the other hand, the acoustic pressure time series is a more feasible modality for data collection in real combustors. To utilize acoustic time series as a sensing modality, we propose a novel cross-modal encoder-decoder architecture that can reconstruct cross-modal visual features from acoustic pressure time series in combustion systems. With the "distillation" of cross-modal features, the results demonstrate that the detection accuracy can be enhanced using the virtual visual sensing modality. By providing the benefit of cross-modal reconstruction, our framework can prove to be useful in different domains well beyond the power generation and transportation industries.
Human review
How the literature uses it
1 arXiv paper cite this in 1 sentence
What it cites · 1 sentence without a confident label
Cites as background 1 paper
-
Conditional Generative Adversarial Nets (GANs) [ref] can direct the data generation process by conditioning the model on additional information.
Conditional Generative Adversarial Nets · Related Work · 0.83
Discussion
Know something about this paper? Leave a comment, or highlight any passage above to comment on it.