Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add points contained info to stats csv #45

Open
sweeney-l opened this issue Dec 16, 2020 · 4 comments
Open

Add points contained info to stats csv #45

sweeney-l opened this issue Dec 16, 2020 · 4 comments
Labels
enhancement New feature or request

Comments

@sweeney-l
Copy link

In the outputed csv with stats about the different scenarios, is is possible to have something like no. of points contained within confidence interval as per rbacon: Bacon?

@villegar
Copy link
Member

In the outputed csv with stats about the different scenarios, is it possible to have something like no. of points contained within confidence interval as per rbacon: Bacon?

@sweeney-l when you say "points", do you mean "dates"? So for the plot below, you want the stats file to report that all four dates are withing the confidence interval?
image

@villegar villegar added the enhancement New feature or request label Dec 16, 2020
@sweeney-l
Copy link
Author

Yep, sorry, mean dates. When you run bacon from rbacon you get something that says e.g. "92% of the dates overlap with the age-depth model (95% ranges)". In your example you would get 100% of dates overlap. As it is already in rbacon, I thought it might also be a relatively easy (!?) way of choosing the best model, based on the discussions we had before. It would certainly discount those scenarios where no dates are inside the CI but are still chosen by the package as the best because the abc and bias values are good

@villegar
Copy link
Member

The only problem here is that since we are running multiple instances of rbacon::Bacon in parallel and capturing all those messages in a single log file (see below), I cannot tell which message belongs to a particular scenario. A possible workaround might be to capture individual log files for each scenario, but I have yet to figure out a feasible way to do this.

Example log file:

100% of the dates overlap with the age-depth model (95% ranges)


--------------------------------------------------------------------------------
|                                Saving results                                |
--------------------------------------------------------------------------------

100% of the dates overlap with the age-depth model (95% ranges)



Mean 95% confidence ranges 406 yr, min. 115 yr at 15.1515151515152 cm, max. 884 yr at 500 cm
--------------------------------------------------------------------------------
|                                Saving results                                |
--------------------------------------------------------------------------------

80% of the dates overlap with the age-depth model (95% ranges)


--------------------------------------------------------------------------------
|                                Saving results                                |
--------------------------------------------------------------------------------

Anyhow, I will have a look, as it will definitely help to drop "false positives" for best models.

@sweeney-l
Copy link
Author

Hmm, yes, I understand.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants