infrastructure/blender-open-data
2
3
Fork 3
Code Issues 15 Pull Requests 1 Projects Releases Wiki Activity

Sample Comparison #56302

New Issue
Closed
opened 2018-08-11 01:19:46 +02:00 by Francesco Siddi · 6 comments
Francesco Siddi commented 2018-08-11 01:19:46 +02:00
Owner
Copy Link

When viewing a sample (for example after submitting it) we would like to be able to compare it to similar samples. Ideally:

  • Best result
  • Slighly better result
  • Our sample
  • Slightly worse result
  • Worst result
When viewing a sample (for example after submitting it) we would like to be able to compare it to similar samples. Ideally: * Best result * Slighly better result * Our sample * Slightly worse result * Worst result
Francesco Siddi commented 2018-08-11 01:19:46 +02:00
Author
Owner
Copy Link

Added subscriber: @fsiddi

Added subscriber: @fsiddi
Francesco Siddi commented 2018-09-09 20:48:08 +02:00
Author
Owner
Copy Link

Added subscriber: @dr.sybren

Added subscriber: @dr.sybren
Francesco Siddi commented 2018-09-09 20:48:08 +02:00
Author
Owner
Copy Link

Addressed feedback on the implementation in the wip-compare-results. Can we have another round of feedback and merge this @dr.sybren?

Regarding the question:

Do you have any idea to extend the query to "the N benchmarks slower/faster than yours"?

We could do the following. For each scene in groupValues:

  • query for the fasted and slowest, near fastest and near slowest results (near values can be an 80% near interpolation from current to extreme - the query should return a device name)
  • each result per scene is properly regrouped and pushed to the chart

This probably does not make much sense, I can elaborate later.

Addressed feedback on the implementation in the [wip-compare-results](https://developer.blender.org/source/blender-open-data/history/wip-compare-results/). Can we have another round of feedback and merge this @dr.sybren? Regarding the question: > Do you have any idea to extend the query to "the N benchmarks slower/faster than yours"? We could do the following. For each scene in groupValues: - query for the fasted and slowest, near fastest and near slowest results (near values can be an 80% near interpolation from current to extreme - the query should return a device name) - each result per scene is properly regrouped and pushed to the chart This probably does not make much sense, I can elaborate later.
Francesco Siddi commented 2018-10-21 19:50:24 +02:00
Author
Owner
Copy Link

This is now partially implemented (when viewing a result, we can compare with the average).

This is now partially implemented (when viewing a result, we can compare with the average).
Francesco Siddi commented 2019-12-09 15:01:48 +01:00
Author
Owner
Copy Link

Changed status from 'Open' to: 'Archived'

Changed status from 'Open' to: 'Archived'
Francesco Siddi self-assigned this 2019-12-09 15:01:48 +01:00
Francesco Siddi commented 2019-12-09 15:01:48 +01:00
Author
Owner
Copy Link

This is now being taken care on the sample view level, as well as via the query view.

This is now being taken care on the sample view level, as well as via the query view.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels   
Priority
High

  
Priority
Low

  
Priority
Normal

  
Status
Archived

  
Status
Confirmed

  
Status
Duplicate

  
Status
Needs Information from Developers

  
Status
Needs Triage

  
Status
Resolved

  
Type
Bug

  
Type
Design

  
Type
Report

  
Type
To Do

No Label
Priority
High
Priority
Low
Priority
Normal
Status
Archived
Status
Confirmed
Status
Duplicate
Status
Needs Information from Developers
Status
Needs Triage
Status
Resolved
Type
Bug
Type
Design
Type
Report
Type
To Do
Milestone
Clear milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
No Assignees
Francesco Siddi
1 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: infrastructure/blender-open-data#56302
No description provided.
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?