Precision of 'Unit Scale' and 'Grid Scale' are mismatched #75998

New Issue

Christopher Gearhart · 2020-04-22T14:51:56+02:00

2020-04-22 14:51:56 +02:00

System Information
Operating system: Windows 10
Graphics card:

Blender Version
Broken: 2.80-2.82
Worked: Issue irrelevant starting at 2.79

Short description of error

The precision of 'Unit Scale' does not match the precision of the overlay's 'Grid Scale'. Although 'Unit Scale' displays 6 digits, it only seems to accept 5, and the trailing zero cannot be changed. The overlay's 'Grid Scale' is accepts precision to 6 digits. Given that 'Micrometers' is an option for Length units, the 'Unit Scale' should maintain a precision to 6 digits, with the ability to choose a scale of '0.000001'.

Exact steps for others to reproduce the error

Open the default startup file
Type '0.000001' into the 'Unit Scale' in the Scene Properties panel (note that it changes to 0.000010)
Type '0.000001' into the 'Grid Scale' in the viewport overlay dropdown (note that it accepts this value)

**System Information** Operating system: Windows 10 Graphics card: <irrelevant> **Blender Version** Broken: 2.80-2.82 Worked: Issue irrelevant starting at 2.79 **Short description of error** The precision of 'Unit Scale' does not match the precision of the overlay's 'Grid Scale'. Although 'Unit Scale' displays 6 digits, it only seems to accept 5, and the trailing zero cannot be changed. The overlay's 'Grid Scale' is accepts precision to 6 digits. Given that 'Micrometers' is an option for Length units, the 'Unit Scale' should maintain a precision to 6 digits, with the ability to choose a scale of '0.000001'. **Exact steps for others to reproduce the error** - Open the default startup file - Type '0.000001' into the 'Unit Scale' in the Scene Properties panel (note that it changes to 0.000010) - Type '0.000001' into the 'Grid Scale' in the viewport overlay dropdown (note that it accepts this value)

Christopher Gearhart commented

2020-04-22 14:51:56 +02:00

Added subscriber: @bblanimation

Ankit Meel commented

2020-04-23 09:39:56 +02:00

Added subscriber: @ankitm

Ankit Meel commented

2020-04-23 09:39:56 +02:00

Type '0.000001' into the 'Grid Scale' in the viewport overlay dropdown (note that it accepts this value)

It does accept that, but note that after increasing one using > button, it goes to .001 & reducing it doesn't change it.

> Type '0.000001' into the 'Grid Scale' in the viewport overlay dropdown (note that it accepts this value) It does accept that, but note that after increasing one using `>` button, it goes to .001 & reducing it doesn't change it.

Richard Antalik commented

2020-04-23 14:22:48 +02:00

Added subscriber: @iss

Richard Antalik commented

2020-04-23 14:22:48 +02:00

Unit Scale property has limited range
RNA_def_property_range(prop, 0.00001, 100000.0);

Grid Scale property goes all the way to 0
RNA_def_property_range(prop, 0.0f, FLT_MAX);

I am not quite sure why this doesn't go down to 10^-6 or in general 10^-(n*3)

`Unit Scale` property has limited range `RNA_def_property_range(prop, 0.00001, 100000.0);` `Grid Scale` property goes all the way to 0 `RNA_def_property_range(prop, 0.0f, FLT_MAX);` I am not quite sure why this doesn't go down to 10^-6 or in general 10^-(n*3)

Ankit Meel commented

2020-05-02 14:22:08 +02:00

For "scale_length",

0.0010000000f, 100.0f, 0.0000100000f, 100000.0f, 0.1000000015f, 6
float softmin, softmax;  float hardmin, hardmax;  float step;  int precision;

For "grid_scale",
0.0010000000f, 1000.0f, 0.0f, FLT_MAX, 0.1000000015f, 3

So

Type '0.000001' into the 'Unit Scale' in the Scene Properties panel (note that it changes to 0.000010)

yes since it's hard min.

Type '0.000001' into the 'Grid Scale' in the viewport overlay dropdown (note that it accepts this value)

since it's hard min is 0.

I am not quite sure why this doesn't go down to 10^-6 or in general 10^-(n*3)

precision is 3.

There can be only so much floating point precision..

For "scale_length", ``` 0.0010000000f, 100.0f, 0.0000100000f, 100000.0f, 0.1000000015f, 6 float softmin, softmax; float hardmin, hardmax; float step; int precision; ``` For "grid_scale", 0.0010000000f, 1000.0f, 0.0f, FLT_MAX, 0.1000000015f, 3 So >Type '0.000001' into the 'Unit Scale' in the Scene Properties panel (note that it changes to 0.000010) yes since it's hard min. > Type '0.000001' into the 'Grid Scale' in the viewport overlay dropdown (note that it accepts this value) since it's hard min is 0. > I am not quite sure why this doesn't go down to 10^-6 or in general 10^-(n*3) precision is 3. There can be only so much floating point precision..

Ankit Meel commented

2020-05-09 12:49:34 +02:00

The described events are working as designed I think. So should I close this as modified behaviour request ?

Richard Antalik commented

2020-05-10 07:26:51 +02:00

Added subscriber: @JacquesLucke

Richard Antalik commented

2020-05-10 07:26:51 +02:00

I haven't closed this because 5 digits is such odd number especially for unit scale. Also engineer in me says that it's wrong.

Seems that @JacquesLucke was involved in units, not sure if he knows if there is technical limitation for scale_length current minimum value.

If there is limitation, I would close this, otherwise it makes sense to me to change scale_length to 0.000001.

I haven't closed this because 5 digits is such odd number especially for unit scale. Also engineer in me says that it's wrong. Seems that @JacquesLucke was involved in units, not sure if he knows if there is technical limitation for `scale_length` current minimum value. If there is limitation, I would close this, otherwise it makes sense to me to change `scale_length` to 0.000001.

Brecht Van Lommel commented

2020-05-10 13:11:46 +02:00

Added subscriber: @brecht

Brecht Van Lommel commented

2020-05-10 13:11:46 +02:00

@iss, I suggest to change the minimum to 1e-9. The current 1e-5 indeed is a strange choice given typical metric units, I don't think there's a particular reason behind it.

Ankit Meel commented

2020-05-10 15:30:24 +02:00

Changed status from 'Needs Triage' to: 'Confirmed'

blender-admin commented

2020-05-11 07:23:22 +02:00

This issue was referenced by 0461727553

This issue was referenced by 0461727553135f4dee29e5888b904835716565c2

Richard Antalik commented

2020-05-11 07:29:49 +02:00

Changed status from 'Confirmed' to: 'Resolved'

Richard Antalik closed this issue

2020-05-11 07:29:49 +02:00

Richard Antalik self-assigned this 2020-05-11 07:29:49 +02:00

Sign in to join this conversation.

No Label

Download

What's New

Blender Studio

Manual

Developers Blog

Documentation

Benchmark

Blender Conference

Development Fund

One-time Donations

Precision of 'Unit Scale' and 'Grid Scale' are mismatched #75998