Can I use an ANN to translate image output from one sensor to simulate output from another sensor?2019 Community Moderator ElectionDetecting cats visually by means of anomaly detectionResearch in high-dimensional statistics vs. machine learning?Why does applying PCA on targets causes underfitting?Can I train two stacked models end-to-end on different resolutions?Regression problem as predicting a delta from another algorithm's outputMulti-image superresolution using CNNshow can I recognize multiple faces from one image in pythonUnsupervised Anomaly Detection in ImagesMatch a uploaded image with another image using machine learning?Robustness of ML Model in question
How much of data wrangling is a data scientist's job?
What's that red-plus icon near a text?
What typically incentivizes a professor to change jobs to a lower ranking university?
Why is 150k or 200k jobs considered good when there's 300k+ births a month?
Maximum likelihood parameters deviate from posterior distributions
How to source a part of a file
Get value of a counter
Why "Having chlorophyll without photosynthesis is actually very dangerous" and "like living with a bomb"?
Can a monk's single staff be considered dual wielded, as per the Dual Wielder feat?
Decision tree nodes overlapping with Tikz
Languages that we cannot (dis)prove to be Context-Free
Can I make popcorn with any corn?
Could an aircraft fly or hover using only jets of compressed air?
Rock identification in KY
Accidentally leaked the solution to an assignment, what to do now? (I'm the prof)
Today is the Center
What does the "remote control" for a QF-4 look like?
Linear Path Optimization with Two Dependent Variables
Revoked SSL certificate
Why doesn't Newton's third law mean a person bounces back to where they started when they hit the ground?
When a company launches a new product do they "come out" with a new product or do they "come up" with a new product?
What is a clear way to write a bar that has an extra beat?
Arrow those variables!
How can bays and straits be determined in a procedurally generated map?
Can I use an ANN to translate image output from one sensor to simulate output from another sensor?
2019 Community Moderator ElectionDetecting cats visually by means of anomaly detectionResearch in high-dimensional statistics vs. machine learning?Why does applying PCA on targets causes underfitting?Can I train two stacked models end-to-end on different resolutions?Regression problem as predicting a delta from another algorithm's outputMulti-image superresolution using CNNshow can I recognize multiple faces from one image in pythonUnsupervised Anomaly Detection in ImagesMatch a uploaded image with another image using machine learning?Robustness of ML Model in question
$begingroup$
Say, for instance, if I had image data from one high resolution digital camera and wanted to make it look like it was taken from another, lower resolution, digital camera? Would training input/output pairs of overlapping images be a good way to do this? What is this technique called?
For example, say I wanted to be able to count benches in parks in LOW resolution imagery. Could I go through these sample images and create an appropriate dataset of high and low resolution pairs to train a network to learn what a low resolution bench looked like? Would I be able to discern low resolution benches if my training set was incredibly diverse (image chips if entire city parks vs individual objects like fountains, trees and statues)?
I like this example because the images come from different sensors as well as being different resolutions. Some of my research has led me to super resolution, which is kind of the opposite of what I'm trying to do.
As for the amount of data, it would be painstaking but not technically difficult to get overlapping high and low resolution imagery.
machine-learning neural-style-transfer
asked Mar 5 at 20:42
Karsten ChuKarsten Chu
63
$endgroup$
add a comment |
$begingroup$
Say, for instance, if I had image data from one high resolution digital camera and wanted to make it look like it was taken from another, lower resolution, digital camera? Would training input/output pairs of overlapping images be a good way to do this? What is this technique called?
For example, say I wanted to be able to count benches in parks in LOW resolution imagery. Could I go through these sample images and create an appropriate dataset of high and low resolution pairs to train a network to learn what a low resolution bench looked like? Would I be able to discern low resolution benches if my training set was incredibly diverse (image chips if entire city parks vs individual objects like fountains, trees and statues)?
I like this example because the images come from different sensors as well as being different resolutions. Some of my research has led me to super resolution, which is kind of the opposite of what I'm trying to do.
As for the amount of data, it would be painstaking but not technically difficult to get overlapping high and low resolution imagery.
machine-learning neural-style-transfer
asked Mar 5 at 20:42
Karsten ChuKarsten Chu
63
$endgroup$
1
$begingroup$
Certainly, this could be achieved but I won't suggest wasting the computation over what could be achieved using simpler image processing techniques.
$endgroup$
– thanatoz
Mar 6 at 6:57
add a comment |
$begingroup$
Say, for instance, if I had image data from one high resolution digital camera and wanted to make it look like it was taken from another, lower resolution, digital camera? Would training input/output pairs of overlapping images be a good way to do this? What is this technique called?
For example, say I wanted to be able to count benches in parks in LOW resolution imagery. Could I go through these sample images and create an appropriate dataset of high and low resolution pairs to train a network to learn what a low resolution bench looked like? Would I be able to discern low resolution benches if my training set was incredibly diverse (image chips if entire city parks vs individual objects like fountains, trees and statues)?
I like this example because the images come from different sensors as well as being different resolutions. Some of my research has led me to super resolution, which is kind of the opposite of what I'm trying to do.
As for the amount of data, it would be painstaking but not technically difficult to get overlapping high and low resolution imagery.
machine-learning neural-style-transfer
asked Mar 5 at 20:42
Karsten ChuKarsten Chu
63
$endgroup$
Say, for instance, if I had image data from one high resolution digital camera and wanted to make it look like it was taken from another, lower resolution, digital camera? Would training input/output pairs of overlapping images be a good way to do this? What is this technique called?
For example, say I wanted to be able to count benches in parks in LOW resolution imagery. Could I go through these sample images and create an appropriate dataset of high and low resolution pairs to train a network to learn what a low resolution bench looked like? Would I be able to discern low resolution benches if my training set was incredibly diverse (image chips if entire city parks vs individual objects like fountains, trees and statues)?
I like this example because the images come from different sensors as well as being different resolutions. Some of my research has led me to super resolution, which is kind of the opposite of what I'm trying to do.
As for the amount of data, it would be painstaking but not technically difficult to get overlapping high and low resolution imagery.
machine-learning neural-style-transfer
machine-learning neural-style-transfer
asked Mar 5 at 20:42
Karsten ChuKarsten Chu
63
asked Mar 5 at 20:42
Karsten ChuKarsten Chu
63
edited Mar 6 at 15:55
Karsten Chu
asked Mar 5 at 20:42
Karsten ChuKarsten Chu
63
asked Mar 5 at 20:42
Karsten ChuKarsten Chu
63
asked Mar 5 at 20:42
Karsten ChuKarsten Chu
63
63
1
$begingroup$
Certainly, this could be achieved but I won't suggest wasting the computation over what could be achieved using simpler image processing techniques.
$endgroup$
– thanatoz
Mar 6 at 6:57
add a comment |
1
$begingroup$
Certainly, this could be achieved but I won't suggest wasting the computation over what could be achieved using simpler image processing techniques.
$endgroup$
– thanatoz
Mar 6 at 6:57
1
1
$begingroup$
Certainly, this could be achieved but I won't suggest wasting the computation over what could be achieved using simpler image processing techniques.
$endgroup$
– thanatoz
Mar 6 at 6:57
$begingroup$
Certainly, this could be achieved but I won't suggest wasting the computation over what could be achieved using simpler image processing techniques.
$endgroup$
– thanatoz
Mar 6 at 6:57
add a comment |
2 Answers
2
active
oldest
votes
$begingroup$
This is very much possible. There is a function which can map the images from the higher resolution pictures to the lower dimensional ones; and a neural network can be trained to learn that function.
However, to train a neural network to do this you will need thousands of images from both cameras. Then you can feed the pictures taken with your higher resolution camera as the input to the network and then compute the loss of the network at the output with the corresponding lower resolution images.
If you do not have so many images, there has been work on taking images and applying some sort of filter to change their appearance. These techniques are often called style transfer, you can find some tutorial here and code which I have tried and can confirm works here. It might be hard to get a representative image to use as the style image using your old camera. You can try an average of a few pictures, or a picture of a white background, you would have to try things out, I do not know what would work in this case.
If you share examples of your data we can help you more.
answered Mar 6 at 1:15
JahKnowsJahKnows
5,227727
$endgroup$
add a comment |
$begingroup$
You noted that there is superresolution, which is a kind of "information adding" to images. The opposite is quite possible but not very useful since lowering resolution can be achieved by many non-machine learning techniques.
You can try:
- Get your high resolution images and camera specifications to use basic image processing to transform images to a result similar to the one of another camera.
- Camera Resolution: Is easy to do with proper image resizing, try different interpolation algorithms.
- Sensor Specifications: how sensitive to light is the sensor? what is the bit depth for color/intensity? Those are things to consider.
- Sensor Amplifier and Other Lightning Condition: Basically, ISO, White Balance and such.
- Try changing these conditions to achieve the desired result
Notes:
If there is difference is sensors construction (For Example one is CMOS and the other is CCD) it might be useful to use "underresolution" that you want to create, since there is large difference in response to light saturation and such.
When training, check for image alignment since this can yield absurd differences for least-square image similarity (you should try using SIMD)
answered 1 hour ago
Pedro Henrique MonfortePedro Henrique Monforte
3007
$endgroup$
add a comment |
Your Answer
StackExchange.ifUsing("editor", function ()
return StackExchange.using("mathjaxEditing", function ()
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
);
);
, "mathjax-editing");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "557"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f46723%2fcan-i-use-an-ann-to-translate-image-output-from-one-sensor-to-simulate-output-fr%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
2 Answers
2
active
oldest
votes
2 Answers
2
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
This is very much possible. There is a function which can map the images from the higher resolution pictures to the lower dimensional ones; and a neural network can be trained to learn that function.
However, to train a neural network to do this you will need thousands of images from both cameras. Then you can feed the pictures taken with your higher resolution camera as the input to the network and then compute the loss of the network at the output with the corresponding lower resolution images.
If you do not have so many images, there has been work on taking images and applying some sort of filter to change their appearance. These techniques are often called style transfer, you can find some tutorial here and code which I have tried and can confirm works here. It might be hard to get a representative image to use as the style image using your old camera. You can try an average of a few pictures, or a picture of a white background, you would have to try things out, I do not know what would work in this case.
If you share examples of your data we can help you more.
answered Mar 6 at 1:15
JahKnowsJahKnows
5,227727
$endgroup$
add a comment |
$begingroup$
This is very much possible. There is a function which can map the images from the higher resolution pictures to the lower dimensional ones; and a neural network can be trained to learn that function.
However, to train a neural network to do this you will need thousands of images from both cameras. Then you can feed the pictures taken with your higher resolution camera as the input to the network and then compute the loss of the network at the output with the corresponding lower resolution images.
If you do not have so many images, there has been work on taking images and applying some sort of filter to change their appearance. These techniques are often called style transfer, you can find some tutorial here and code which I have tried and can confirm works here. It might be hard to get a representative image to use as the style image using your old camera. You can try an average of a few pictures, or a picture of a white background, you would have to try things out, I do not know what would work in this case.
If you share examples of your data we can help you more.
answered Mar 6 at 1:15
JahKnowsJahKnows
5,227727
$endgroup$
add a comment |
$begingroup$
This is very much possible. There is a function which can map the images from the higher resolution pictures to the lower dimensional ones; and a neural network can be trained to learn that function.
However, to train a neural network to do this you will need thousands of images from both cameras. Then you can feed the pictures taken with your higher resolution camera as the input to the network and then compute the loss of the network at the output with the corresponding lower resolution images.
If you do not have so many images, there has been work on taking images and applying some sort of filter to change their appearance. These techniques are often called style transfer, you can find some tutorial here and code which I have tried and can confirm works here. It might be hard to get a representative image to use as the style image using your old camera. You can try an average of a few pictures, or a picture of a white background, you would have to try things out, I do not know what would work in this case.
If you share examples of your data we can help you more.
answered Mar 6 at 1:15
JahKnowsJahKnows
5,227727
$endgroup$
This is very much possible. There is a function which can map the images from the higher resolution pictures to the lower dimensional ones; and a neural network can be trained to learn that function.
However, to train a neural network to do this you will need thousands of images from both cameras. Then you can feed the pictures taken with your higher resolution camera as the input to the network and then compute the loss of the network at the output with the corresponding lower resolution images.
If you do not have so many images, there has been work on taking images and applying some sort of filter to change their appearance. These techniques are often called style transfer, you can find some tutorial here and code which I have tried and can confirm works here. It might be hard to get a representative image to use as the style image using your old camera. You can try an average of a few pictures, or a picture of a white background, you would have to try things out, I do not know what would work in this case.
If you share examples of your data we can help you more.
answered Mar 6 at 1:15
JahKnowsJahKnows
5,227727
answered Mar 6 at 1:15
JahKnowsJahKnows
5,227727
answered Mar 6 at 1:15
JahKnowsJahKnows
5,227727
answered Mar 6 at 1:15
JahKnowsJahKnows
5,227727
5,227727
add a comment |
add a comment |
$begingroup$
You noted that there is superresolution, which is a kind of "information adding" to images. The opposite is quite possible but not very useful since lowering resolution can be achieved by many non-machine learning techniques.
You can try:
- Get your high resolution images and camera specifications to use basic image processing to transform images to a result similar to the one of another camera.
- Camera Resolution: Is easy to do with proper image resizing, try different interpolation algorithms.
- Sensor Specifications: how sensitive to light is the sensor? what is the bit depth for color/intensity? Those are things to consider.
- Sensor Amplifier and Other Lightning Condition: Basically, ISO, White Balance and such.
- Try changing these conditions to achieve the desired result
Notes:
If there is difference is sensors construction (For Example one is CMOS and the other is CCD) it might be useful to use "underresolution" that you want to create, since there is large difference in response to light saturation and such.
When training, check for image alignment since this can yield absurd differences for least-square image similarity (you should try using SIMD)
answered 1 hour ago
Pedro Henrique MonfortePedro Henrique Monforte
3007
$endgroup$
add a comment |
$begingroup$
You noted that there is superresolution, which is a kind of "information adding" to images. The opposite is quite possible but not very useful since lowering resolution can be achieved by many non-machine learning techniques.
You can try:
- Get your high resolution images and camera specifications to use basic image processing to transform images to a result similar to the one of another camera.
- Camera Resolution: Is easy to do with proper image resizing, try different interpolation algorithms.
- Sensor Specifications: how sensitive to light is the sensor? what is the bit depth for color/intensity? Those are things to consider.
- Sensor Amplifier and Other Lightning Condition: Basically, ISO, White Balance and such.
- Try changing these conditions to achieve the desired result
Notes:
If there is difference is sensors construction (For Example one is CMOS and the other is CCD) it might be useful to use "underresolution" that you want to create, since there is large difference in response to light saturation and such.
When training, check for image alignment since this can yield absurd differences for least-square image similarity (you should try using SIMD)
answered 1 hour ago
Pedro Henrique MonfortePedro Henrique Monforte
3007
$endgroup$
add a comment |
$begingroup$
You noted that there is superresolution, which is a kind of "information adding" to images. The opposite is quite possible but not very useful since lowering resolution can be achieved by many non-machine learning techniques.
You can try:
- Get your high resolution images and camera specifications to use basic image processing to transform images to a result similar to the one of another camera.
- Camera Resolution: Is easy to do with proper image resizing, try different interpolation algorithms.
- Sensor Specifications: how sensitive to light is the sensor? what is the bit depth for color/intensity? Those are things to consider.
- Sensor Amplifier and Other Lightning Condition: Basically, ISO, White Balance and such.
- Try changing these conditions to achieve the desired result
Notes:
If there is difference is sensors construction (For Example one is CMOS and the other is CCD) it might be useful to use "underresolution" that you want to create, since there is large difference in response to light saturation and such.
When training, check for image alignment since this can yield absurd differences for least-square image similarity (you should try using SIMD)
answered 1 hour ago
Pedro Henrique MonfortePedro Henrique Monforte
3007
$endgroup$
You noted that there is superresolution, which is a kind of "information adding" to images. The opposite is quite possible but not very useful since lowering resolution can be achieved by many non-machine learning techniques.
You can try:
- Get your high resolution images and camera specifications to use basic image processing to transform images to a result similar to the one of another camera.
- Camera Resolution: Is easy to do with proper image resizing, try different interpolation algorithms.
- Sensor Specifications: how sensitive to light is the sensor? what is the bit depth for color/intensity? Those are things to consider.
- Sensor Amplifier and Other Lightning Condition: Basically, ISO, White Balance and such.
- Try changing these conditions to achieve the desired result
Notes:
If there is difference is sensors construction (For Example one is CMOS and the other is CCD) it might be useful to use "underresolution" that you want to create, since there is large difference in response to light saturation and such.
When training, check for image alignment since this can yield absurd differences for least-square image similarity (you should try using SIMD)
answered 1 hour ago
Pedro Henrique MonfortePedro Henrique Monforte
3007
answered 1 hour ago
Pedro Henrique MonfortePedro Henrique Monforte
3007
answered 1 hour ago
Pedro Henrique MonfortePedro Henrique Monforte
3007
answered 1 hour ago
Pedro Henrique MonfortePedro Henrique Monforte
3007
3007
add a comment |
add a comment |
Thanks for contributing an answer to Data Science Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f46723%2fcan-i-use-an-ann-to-translate-image-output-from-one-sensor-to-simulate-output-fr%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
1
$begingroup$
Certainly, this could be achieved but I won't suggest wasting the computation over what could be achieved using simpler image processing techniques.
$endgroup$
– thanatoz
Mar 6 at 6:57