AskiaAnalyse: team me up, Scotty!

The software in the Askia range have been designed to work alongside each other.  If you know how your survey tree looks in Design, you will not be surprised by how it looks in Analyse. That’s the whole point of an integrated suite.

Analyse has mainly been designed to work with a single user, creating their weightings, calculated variables and filters in their QES file.

When we realised that a lot of our users were working on continuous surveys, we introduced Surf files: the analysis definitions were stored in the Surf files so there was no problem whenever you were adding more data.

However, there were two types of user for which Askia Analyse was not performing well:

1. People importing their data from an external source (e.g. triple-S, SAV, Dimensions etc)

They would import their data, maybe create a question tree structure in Design and create multiple questions or loops in Tools. Then they would create variables, weightings and sub-populations in Analyse and save their portfolios.

Now if there was any problem with the source data, such as, additional data or cleaning errors, the whole import would have to be done again. Of course, we provided ways to improve the speed of the process:

…but we wanted to make things quicker.

2. People within large teams

In large teams, a portfolio could be created by someone and run by someone else. It’s not always the same people who create the Surf file and use it. Again we had made sure that the portfolios can be shared. If someone created a sub-population within a portfolio, it would be re-created in Analyse but what about calculated variables, recodes and weightings?

To please all these users, we have implemented a new range of developments:

myView

Firstly, we have implemented myView: it lets users re-organise and hide variables as well as hide responses and automatically associate calculated or grouped responses to questions. It’s something we have given a lot of TLC to. Since the ‘my limited view’ definition is stored outside the QES or QEW (in an .mlv file), if your survey changes (after a re-import), the myView file can be re-used (and opened automatically).

Portfolio improvements

Secondly, we have stored a few more things in the portfolio. The weightings and even the calculated variables & recodes. This means that if you use any weighting or portfolio (as well as tab-template and sub-population), their definition will be saved in the portfolio. If you re-open that portfolio in a different QES or QEW, all these definitions will be re-created automatically! – If these already exist in the survey; the system will warn you if they are different.

Creating loops

Finally, an ambitious development scheduled for 5.3.5.5. We have decided to let people create loops in Analyse (well they are called levels, aren’t they?). This means even if you have data in Surf, you will easily be able to bring questions into loops without writing edits or transforming several files in Tools.

Is Askia compatible with Windows 10 ?

AskiaSuite

Starting from version 5.3.5 of AskiaSuite (askiadesign & askiaanalyse), our beloved swiss-army knife software suite is compatible with Windows 10.
AskiaSuite 5.3.3 is NOT yet compatible (as of November 2015) with Windows 10.
Please check the comments below to see the latest update.

Supervisor & CATI

While askiafield 5.3.3 appears to be compatible, we recommend using the latest 5.3.5 versions, for the sake of matching your AskiaSuite version.

Web-based applications

Our browser-based applications, such as askiavista or askiaweb are not affected by client OS changes and thus remain compatible.

Happy upgrade!

 

Askiavista 6.0.3.7

Our latest update to askiavista, our online data analysis and reporting web app, is finally here! Version 6.0.3.7 is an incremental update that contains many fixes and some useful new features:

Scenarios

Askiavista can now make use of askiadesign‘s useful Scenarios (aka Versions) in order to filter the list of questions and/or responses. This allows you to customise the display of your survey variables and responses based on the sets of Scenarios defined in askiadesign.

In the case of an omnibus survey, you could for example create a Scenario for Client A that comprises the demographic variables as well as the client’s specific questions; create a second Scenario for Client B with the same demographic data as well as this client’s variables, etc… Thus, allowing each end-user to only view the appropriate subset of data.

Scenarios are functionally very similar to Packages (a feature that has been available in askiavista for many years now)… but the two main advantages of Scenarios are:

  • They do not require to be re-defined; once they have been initially set in askiadesign, askiavista will pick up the Scenarios automatically
  • Where Packages were limited to filtering questions, Scenarios can filter both questions and response items

Specify questions when exporting a portfolio

Askiavista’s API has been updated in order to allow users to override certain (or all) cross-tab dimensions with the profileRows, profileColumns and profileEdges properties that have been added to the askiaVista.display method.

So, if your cross-tab query uses a Portfolio item, these above properties will override the entire list of questions for the specified dimension.

Core components updated

Some of askiavista’s core components have been updated:

  • AVS now supports the RowQuestion, ColQuestion,RowSubQuestion and ColSubQuestion keywords.
  • Fixed an issue with commented askiascript
  • Fixed an issue with Row / Edge suppression
  • Fixed an issue where the Use unweighted base in Col Sig with selected no weighting caused results to disappear
  • Various fixes to ensure Mode and Average number of responses are displayed correctly

Bug fixes

As usual, we have slaughtered some pesky bugs while we were at it; some of the more notable ones are:

  • Fixed an issue where no data was displayed for the total by Row and total by Question for Arithmetic calculations by script
  • Fixed an issue where totals were missing in Portfolios when exported to Excel
  • Fixed an issue where the Export Activity to Excel produced a corrupt Excel file

You can access the full version notes or pick up the update immediately!

New version 5.3.5.0 of askiaanalyse

This post is the second in a series that detail the key features in version 5.3.5.0 of askiadesign & askiaanalyse. The blog post on askiadesign 5.3.5.0 can be found here.

Much development work has been invested in 5.3.5.0 to take our Analysis software to the next level. A detailed list of these great new features can be found in the version roadmap. Below are a summary and examples of several key developments:


Table of contents:

    1. Table arithmetic (Cleaning script)
    2. Aggregated scripts
    3. Table arithmetic (Calculation arithmetic)
    4. Table suppression
    5. Paste captions
    6. New keywords in script calculations
    7. New options in level

For items 1 to 3 there is a range of articles on our help centre which go into a greater amount of detail than we will in this post. The objects, properties and methods for the new scripting language are summarised in this document.

 


Table arithmetic (Cleaning script)

The ‘Cleaning script’ is a process that runs immediately after your table is created. It changes the appearance of a table based on the figures it has in it. So, for example, you can have sophisticated conditional formatting or fill text and numbers into cells of your choice using syntax. Here I will demonstrate how to change the default column significance lettering to display a shape of a particular colour.

In the table below we are testing each column against the total column only – we can see if it is significantly different by the letters returned from some of the pre-set options: higher (“A+”) or lower (“-A+”).

clean2

What if the requirement is to show something other than these pre-set options e.g. a green ▲ for higher and a red ▼ for lower

The ‘Cleaning script’ window is found in the Tab definition > General tab > Settings > Sorting. We can achieve this requirement by adding the script below. It’s basically script that defines the data range first (StartX, StartY) (2, 5) to (MaxX, MaxY) (10, 18).Then it carries out a find and replace to insert the shapes and formats where required.

clean4

The portfolio and .qes file containing the tab template shown above can be downloaded here. The end result is as follows:

clean1

 


 Aggregated scripts

In basic terms, aggregated scripts are a way of retrieving aggregated information e.g. a mean or median. So you can now create coded variables from this point like: those above mean / those below mean and this variable won’t require additional work when new data is added to the .qes file (and the mean changes).

The example .qes file can be downloaded here. Take a look at variable avg#3. We are able to display the average time in the correct format by first working out the mean of Q4a. We use Q4a.data.mean() (17.73) to do this. In the second line we work out the mean with no decimal places (17). In the third line we work out the difference 0.73 and re-factor it be between 0 – 60 (44). Then, finally, we insert these numbers into the text we want to display: “Average Time – [17:44]”

as1

The above example shows aggregated scripts for use in created variables but they can also be used in the cleaning script and calculation arithmetic script modes. The latter is demonstrated in the example portfolio in tab definition: Average Time – Method 1. Here there is the calculation: Average Time which performs a similar format adjustment on our mean for Q4a.
 


Table arithmetic (Calculation arithmetic)

In the example .qes file and portfolio which can be downloaded here, open the tab definition: 2.TA_Calc_Arithmetic. 

Here you will see a 10 point rating scale for 10 brands. The aim is to create a simple calculation:

100 * sum of (count x rating) for one brand / sum of (count x rating) for all brands

So for the first brand it would be: 100 * (182) / total of all entries in the ‘Sum’ row (1498) = 12.15

ta2

When using calculation arithmetic we think of every cell in the table as having x & y co-ordinates e.g. the top left cell has co-ordinates (1,1)

We define our range of cells we want to sum across:

j = CurrentTable.startX to CurrentTable.maxX

Where startX is the first column which contains data (3) and maxX is the last column (12) now we sum up all the values contained in these cells on the 12th row (Sum) using the following syntax:

i = i + CurrentTable.getcell(j,12).value

 Note, here you can replace the y co-ordinate of 12 with:  CurrentTable.maxY – 1  – this also means the 12th row but will automatically look at the 13th row if one more rating is added to the scale.

Now that we have our ‘total of sums’ we divide the sum calculation, Calc(1), by this to get our desired result using: return (Calc(1) / i) * 100

You may have noticed that we now use Calc(1) instead of the calculation reference we used previously {1}. This is necessary for adding the new scripting language in this calculation type. References previously saved as {n} here will be automatically updated to Calc( n ).


Table suppression

For the first time in Analyse, we have the ability to fully suppress tables from the output if the table base is below a certain number. You have the flexibility to set this threshold in the same way as you can for setting row / column / edge suppression:

bts1

The usual requirement is blank table suppression which removes empty tables from outputs. In this case you would of course set ‘if base <=’ to 0
 


Paste captions

A new option, Paste captions, has been added to the context menu when you are working in the row / columns / edges of your tab definitions. If you’ve ever had to make a large number of text changes to variables or code captions in the tab definition, you’ll know it would have taken time to paste/write them in to each of these elements individually.

Now you can create your updated text in Word or Excel, for example, and paste captions in wholesale on to your variables or codes to save a lot of time when faced with this sort of exercise.

pc1
 


New keywords in script calculations.

You can now use RowQuestion, RowSubQuestion, ColQuestion, ColSubQuestion in calculations by script

You may be aware how to use script calculations in Analyse:

kw1

If not, there is a fairly informative article here which steps through some usage examples. There is another article here which concentrates on scripts used to create mean summary tables.

Basically, it’s a script stored in a calculation which allows you to access or filter your results by a question which is not in your tab definition.

The example files are here. Open up ‘6.AS_Keywords_Portfolio.xml’ and in the tab definition there is a demonstration of this in the calculation: ‘n (q4)’. The script here is  ??q4?? Has {1;2}

This filters the counts in our table by those who answered ‘Excellent’ or ‘Very good’ at q4.

This is a question specific script. It means that should we be required to apply this for the same table set-up but different questions then the calculation would not work. e.g. loop1 (replaced with loop2) and q4 (replaced with q5). In Analyse 5.3.5.0 we have introduced some new keywords to circumvent this inflexibility.

Take a look at the calculation ‘n (Generic)’. The script here is: RowSubQuestion Has {1;2}

kw2

The results here are the same as those given by ‘n (q4)’ but, of course, now allow flexibility to use this tab template definition across different loops / variables.
 


New options in level

There are two new options added to the ‘Level’ drop-down box in the tab template:

rl_cl_options

The aim here is much the same as in the previous section, to reduce the number of tab templates we need to create.

An example is when you create a summary table (let’s say for loop1) and want to show figures for the response level rather than the respondent level. We set the level here to loop1 and save the tab template. Previously we couldn’t use the same tab template for the summary table for, let’s say, loop2 but now we can using these options.

The new keywords in script calculations and these level options add a great new level of efficiency for tab template management.

Askiavista 6.0.3.6 released!

We’ve released an update to askiavista, our data analysis & reporting web application. This update is packed with new features (and we also hunted down some pesky bugs):

Manage concurrent user sessions

We’ve added the possibility for askiavista administrators to enable / disable concurrent user sessions for askiavista 6.x. This setting can be global or per user group in order to better adapt to your needs.

Askiavista 6 activity reports

To prepare for Askiavista’s brand new Administration module, we have began implementing user activity (for version 6) reports in the askiavista database. We log a vast array of activity-related data: activity IDs, user IDs, query IDs, session IDs, actions, requests, errors, IP addresses, timings, server responses, … and many many more!

All this information can be found in askiavista’s Administration module, under Configuration > Management Report.

Improved 3-way suppression

We have improved the ‘3-way suppression’ property (as well as ‘Treat edges individually’) as they will now be activated by default when the user selects suppression for rows, columns and edges. Less clutter +increased efficiency = win!

Hide variable distribution

The variable Distribution panel (that sits below your survey structure) could already be collapsed or expanded… it can now be hidden by default! You can activate this optional setting in your User Preferences.

Updated AskiaVistaServer

This update of our calculation engine includes many little fixes and improvements, such as:

  • Use Unweighted base for Significance and Test Value
  • Fixes flat counts where the question was not displayed on a tab of its own
  • Fixed Z-test on unweighted bases when using a Filter
  • … and more!

Squashed bugs

  • Inverted ‘Show a column order letter’ option
  • V5 filter definition not displaying in V6
  • Fix the batch user import feature
  • On-the-fly Filters not taken into account when exporting the portfolio to Excel

You can read the changelog for more details or check this update on our demo server now!

Askiavista updated to 6.0.3.5

We’re excited to announce that a new version, 6.0.3.5, of askiavista is available; as usual, this update contains some nice new features as well as some dead bugs!

New default expiry page

We have updated the default expired page for Portfolio Links which have been set with the Expiry date option. This new page is fully responsive and can be customised to better correspond to your needs.

Screenshot of askiavista's 6.0.3.5 new expiry page

This page is stored in at the root of the AskiaVistaReader.Net4 folder, so don’t hesitate to go crazy on your custom expiry pages!

You can read more about this new page if you want!

Updated log in page

We have updated askiavista’s log in page in order to get rid of some layout issues we had on the previous version and to improve the page’s responsiveness.

Screenshot of Askiavista 6.0.3.5's new login page

We also cleaned it up a tad, increased the size of the inputs & button and generally made a clearer version of the page; but, do remember that you can create your own custom login page!

Highcharts, improved & extended!

We have greatly improved our integration of Highcharts charting library by adding some extra components such as:

  • highcharts-more.js (allows new chart types, such as: Area range, Area spline range, …)
  • modules/funnel.js (adds support for Funnel charts)
  • modules/exporting.js (allows to activate chart export to print, JPG, PNG, SVG & PDF)
  • modules/solid-gauge.js (adds support for solid gauge charts)

We were therefore able to add several new charts to askiavista: Bubble, Spline, Area spline, Scatter & Waterfall charts:
Screenshot of Askiavista's new chart types

Improved search capabilities

We’ve drastically improved the Search questionnaire functionality that is located in the treeview:

  1. We have increased the maximum amount of search results from 30 results to… 500!
  2. When you have searched for a specific question or set of questions and select a search result, you no longer lose your selection(s) when you deactivate the search functionality.

Locate questions in the treeview structure

We have added an askianalyse-inspired feature: having the possibility to Locate a question in the treeview by selecting it directly from the Dimensions panel (Rows, Columns or Edges) in which you are using it.

Screenshot of Askiavista 6.0.3.5's locate feature

This feature is particularly useful when trying to locate a specific variable in the survey structure when said questionnaire is very large.

Fixed an issue with Portfolios and Filters imported from Analyse

We fixed an issue that some of our users experienced when running a Portfolio with a Filter imported from Analyse, the filter would appear twice in the Filter select menu. The portfolio would target the second filter and wouldn’t show any data in the table. All fixed now!

Fixed issue with table style & chart type refresh

Finally, we fixed two issues that concerned rendering issues with table styles and charts when these were refreshed:

  1. Table style refresh issue: when you added a new Table style, askiavista would not take the new CSS into account; the user had to manually trigger the table style refresh by drag and dropping one or more variables in Dimensions.
  2. Chart type refresh issue: when the application rendered more than one chart on a given Table definition and the user modified the Chart type, only the first rendered chart would adopt the newly selected chart type.

That’s all for version 6.0.3.5! Next update is just around the corner!

Askiavista is really growing!

Update: we have updated askiavista to version 6.0.3.5, read more about it!

Yup, askiavista is nearly a grown-up! But because it’s an Askia application, it’ll always be a bit childish 😉 .

We are unleashing the latest update to askiavista, version 6.0.3.4; this latest release is packed with several nifty features and some squashed bugs:

Single Sign-On

We introduced SSO compatibility a couple of years ago but this useful feature has finally made it through to version 6! For this, we have introduced a new web service, AskiaVistaSSO, that is in charge of:

  • creating a unique & secure TrustKey
  • sending the TrustKey to AskiaVista Manager
  • authorises the user to connect or not to askiavista

Check the full details on this.

Replay multiple queries simultaneously

AskiaVista API’s Replay Plugin allows developers to replay a given query with few changes; it’s specially useful for cross-tab queries that produce tables or charts.

Let’s imagine you have a dropdown with the list of filters (sub-populations) from which the user can choose a given filter that will replay a table by applying it the selected filter.

The new version of the Replay plugin allows the developers/users to replay several tables or charts in one go.

So, when the user selects a filter it could be applied to multiple tables or charts at the same time.

In the background the Replay plugin uses a transaction to execute all queries in a single server-side call. The main benefit is to reduce the amount of bandwidth & queries between the client and the server.

Askia.config path now in the Registry

Up until now, the Askia.config file path was stored in IIS’  web.config file (a bit of an inception, eh?). Because any update could overwrite the web.config file, we often ended up with errors related to the configuration file not being found.

To improve this, askiavista searches the Askia.config path in the following order:

  1. In the directory of the current application
  2. If not found, it searches for the web.config as usually
  3. If not found, it search in the Registry

Read the feature request for more information.

Bug fixes

Finally, we have also fixed some outstanding issues in askiavista 6.0.3.4, check below for the most important ones:

  • Empty table when deactivating all calculations for tables (#6349)
  • Calculated responses not copied when copy/paste presentation (#6362)
  • Hidden responses displayed in xtab when moving variables around R/C/E (#6388)
  • Drag Drop filter is not applied to Excel export from a Portfolio (#6413)
  • Scaled-response questions are not treated as closed (#6421)
  • Cannot remove ‘Mean’ calculation caption from table and chart (#6455)
  • Total column and Edge inverted in the Property panel (#6476)
  • AskiaVistaManager can crash several times starting (#6483)

Oh, and did I mention that we have started to play with the amazing D3.js data visualisation library? It’s still just a playground but check this out! Thanks to Brice for his great work on that!

That’s all for now folks 😀

Version 5.3.4.0: askiaanalyse

This post is the second in a series of two that detail the key features in version 5.3.4.0 of askiadesign & askiaanalyse.

Much development work has been done in 5.3.4.0 which bring about a whole host of great new features. A detailed list of these can be found in the version roadmap. Below are five of these features.


Table of contents:

    1. Improvement of inverted data format.
    2. Nested Edges.
    3. Sig Test Options Stored In Variable / Column.
    4. Excel Export Options.
    5. Weighting Efficiency.

 


Improvement of inverted data format

Inverted data is stored and read variable by variable rather than by respondent. This generally speeds up processes such as downloading, expor ting, importing and recalculating. It is another data format which stores data in a .dat folder rather than in just a .qes file.

Inverted data format options

The ‘Re-invert database’ option in Askia Analyse is used to invert the data and the ‘Open an inverted survey’ option is used to access this data format in Askia Tools.

In Analyse 5.3.4.0 a number of improvements have been made to this format:

  • We have decided to rename the old files and not use the number of responses as an extension – this was causing unnecessary problems when a question was recalculated or if the max number of responses was manually changed in Design. The extension of the inverted data files  is always .dat.
  • The developed questions in a loop are no longer stored individually – the grayed questions always contained the information so we thought the cost of reading the whole grayed data for that question was a small price to pay compared to store all the data twice. This significantly decreases the number of files and lets you easily change your mind about the “Develop level” option in Design.
  • We store the system data – or peri-data – such as start time, end-time, IP-address, completion, …
  • The data is compressed which can gain up to 95% diminution of file size ( versions prior to 5.3.4.0 were a simple uncompressed copy of the memory)
  • We have backwards compatibility: inverted data produced with a version prior to 5.3.4.0 is read properly in Analyse. The new inverted files are readable by Vista but not by older versions of Analyse or Tools.

In most tests we have seen 85-95% decrease of the inverted database size and no noticeable deterioration in the reading speed. For example, in the last test, I reduced the size of a .dat folder from 4.2 GB to 45.0 MB. In order to convert from the old to the new format you can use the following steps:

  1. Open the old format inverted data in Askia Analyse 5.3.4.0 version or higher.
  2. File > Export a sub-population
  3. Select the new target file > select ‘All interviews’ as the sub-population > check ‘Export as inverted database’. At this stage you can also select any calculated variables to export or that can be done after by copying / importing the variables from one file to another.

 


Nested Edges

Prior to Analyse 5.3.4.0, the variables you place in your edge would be line up side by side in your edge banner. So, for example, if I have three variables in my edge with 2, 3 and 4 categories then I would have a single edge banner of 9 categories.

From 5.3.4.0 onwards you have the option to change this so that your edges build upwards and you can have two or more variables (edge banners) layered on top of each other. The result from the example above is that you have 2 x 3 x 4 = 24 crossed categories created.

The benefit of Nested edges is that they allow you to have many crossed variables / dimensions in your tables. Previously you would be limited to three before you had to start thinking about using scripts, crossed calculated variables or sub-populations.

Without setting:

Edges in askiaanalyse

Settings for nested edges in askiaanalyse

With setting: – order of nested edges depends on order of variables in Edge

Cross-tab with 2 nested edges in askiaanalyse

You can keep layering them up e.g. if we add another variable, ‘Agreement’, into our edges:

Multiple nested edges in askiaanalyse

We get the following:

Cross-tab with 3 nested edges in askiaanalyse

It’s worth noting that you cannot have a hybrid situation where you have some edges layered and some not. You will have to manage this using your columns as well as your edges.

Example of usage

 


Sig Test Options Stored In Variable

Up to now, it was only possible to store col sig options in the tab template. Therefore, the same tab template would need to be replicated for small tweaks in the testing. The purpose of this new feature is to enable more flexibility by storing the col sig options in the column profile and by doing so reduces the number of tab templates required.

The closest relation we have to this new feature in versions prior to 5.3.4.0 is ‘Specify columns’.

Specify test columns for column significativity

The only difference with the latest option is that the Test cols test is not entered into the advanced options (above left) but instead the column profile by right clicking in the columns and selecting ‘Col-sig testing’ (below).

Specify test columns in column profile

Since these options can be stored in the columns, they will also be saved in a profile or a portfolio.

Example of usage

 


Excel Export Options

Prior to Analyse 5.3.4.0, we had the set of options (A) below. Now since 5.3.4.0 we have set of options (B) which allow more flexibility in organising your Excel tabulations.

Excel export options

The following is a description of what these additional options do:

New sheet for each portfolio chapter

When you are in the portfolio view you can right-click > Insert a chapter. This has the use of keeping large portfolios tidy by organising the tab definitions into sections. With the ‘New sheet for each portfolio chapter’ option set you can now export each of these chapter sections to its own sheet in Excel. So the below will give you 2 sheets. Sheet 1 has 16 separate tables and sheet 2 has 10 separate tables.

New sheet for Portfolio chapter in askiaanalyse

New sheet for each tab definition

A tab definition is created in a portfolio every time you press the yellow folder with green arrow icon in the view below:

New sheet for each tab definition in askiaanalyse

In the example below we have created 3 tab definitions. The shown settings will output 3 sheets in Excel. Sheet 1 has 8 separate tables, sheet 2 has 8 separate tables and sheet 3 has 10.

New sheet for each table definition in export to Excel options

New sheet for each edge

We have 5 variables in the rows and four responses in the edge. Our settings dictate that we therefore have 5 x 4 tables.

With the old settings we could select:

‘One tab per sheet’ – Yes, which would give us 20 sheets in our Excel output or

‘One tab per sheet’ – No, which would give us 1 sheet in our Excel output.

One tab for every response in edge option in askiaanalyse

Now with the following settings we can create an Excel output which has 4 sheets, one for each edge response. Each of the 4 sheets contains 5 separate tables, one for each variable in the rows.

New sheet for each edge option in askiaanalyse

It’s worth noting here if you were to also set ‘One tab per sheet’ – Yes, and rerun your tables, the output would be 20 sheets. This setting overrides the others. Furthermore, if you use the three settings in conjunction with each other, the setting which produces the greater number of tables will take priority.

 


Weighting Efficiency

The weighting efficiency is a measure of how much skewing we have had to do in order to get the weights to converge – the result is a percentage. The closer it is to 100% the less skewing.

In 5.3.4.0. onwards, when you run a weighted set of tables, a file called “Report of weights.txt” is created in the .dat folder that belongs to the .qes file you have opened in Analyse. If the .dat folder doesn’t already exist, it will be created.

An explanation of the weighting efficiency formula can be found here.

Reviewing the attached WeightingEfficiency.xlsx file should also help to understand how we arrive at the weighting efficiency figure.

This looks at the 24 interviews we have in the Data.qes and for each interview lists the weighting factors in column E. In the range L2:U36 it works out, step by step, the numbers required for eventually arriving at the weighting efficiency of % 80.05722937.

Weighting efficiency in askiaanalyse

In WeightingEfficiency.rar there is a .qes and weighted portfolio. If you open these and run the results, you should see the following in the Report of weights.txt created in the .dat folder:

Weighting efficiency report in askiaanalyse

The weighting info on the first line relates to the weighting options you have set:

-Min weight-            -Max weight-            -Number of possible iterations-         -Accuracy-

Weighting options in askiaanalyse

The maximum weight displayed in this file is different to what you’ll see in the weighting options because the base calculated by summing the weighting factors (24.82096438) is different to the unweighted base (24).

If you interview 100 people, and you set your base to be 10,000,000, a “normal” interview would have a weight of 10,000

If you set the maximum weight to 5, it means the algorithm will ensure the weight will not allocate a weight 5 times more than a normal interview. In this particular example, it means it will keep all interviews’ weights under 50,000.

Cumulative updates & future milestones

Over the past month, we have slightly shifted our development & release process with askiavista: instead of longer development cycles with many fixes & improvements, we have began to release smaller versions that mainly include fixes where new features are added at a slower pace.
This helps us maximise our response rate when fixing urgent issues. So, we are doing our best to release early, release often.

Below, a breakdown of the two latest minor updates for askiavista:

Version 6.0.3.1

released 21/11/2014

  • Add footnotes property to tables (new)
  • Export all in one page to Excel (fix)
  • Czech characters not rednered in MS Excel export (fix)
  • Infinite loader on Results when removing a raw data variable (fix)
  • Raw data response sorting not maintained when saved to Portfolio (fix)
  • User level survey offline status not taken into account (fix)

Version 6.0.3.1

released 24/11/2014

  • View switcher breaks when deleting Profiles and/or Portfolios (fix)
  • AskiaVista6 unable to open survey with numeric name (fix)
  • Vista6 – does not remove selected question when the question appears more than once in R/C/E (fix)
  • Calculated responses don’t compute the correct amount of responses (fix)
  • Portfolio linkID cannot be customised (fix)
  • Superpose response is applied when it shouldn’t be (fix)
  • Sub-population by GUI from V5 is not well interpreted in V6 (fix)
  • HTML encoding issues (fix)
  • Adding / removing a Profile or Variables empties the list of Profiles or Variables (fix)
  • Online – offline survey status causing issues (fix)

Future milestones

6.0.3.3
  • Export to PDF (new)
  • Highcharts not displaying Mean & combination charts (fix)
  • The chart is not saved into the template (fix)
  • Issue with fixed header in Firefox (fix)
  • Assigned factors not saved in Portfolio (fix)
  • Empty table when deactivating all calculations for tables (fix)
  • Erratic results in Search questionnaire (fix)
6.0.4.0

The integration of askiavista into askiaadmin that is planned for version 6.0.4.0.

Later

The improvement of AskiaVistaServer farming. This major overhaul has not yet been assigned to a version (and it may actually be introduced before the askiaadmin integration.

Significance and Count Threshold

Why does significance change when I switch level or add waves of data in Askia Analyse?

This post explains which count is considered for the ‘Count threshold’ setting in Col sig advanced options. There is detail on how to calculate ‘Counts when independent’ and why this can change sig testing when the total base grows.


From time to time clients will raise a query regarding sig testing (Column significativity on closed) for a particular cell changing when the total base of their table grows, even though the count and % for cells in the table remains the same. E.g. this can happen when new waves of data are added or the level has been changed to show the response counts rather than respondent counts.

The reason for this is almost certainly the Count threshold setting in the col sig advanced options; it has been left as the default value, 5.

Column significativity advanced options in askiaanalyse

The Count threshold does not use the counts you would normally see in your tables but, instead, it uses the counts from the calculation Counts when independent.

You need to use the count when independent rather than the actual count because the usual count in the cell (crossed count) can still carry importance at low or zero counts.

Below is an example of when the the sig testing changes even though the count and % have remained the same (see column G)

Example of sig test change in askiaanalyse

5 is the default because this doesn’t bring to your attention differences which are not statistically important. The side effect is that you can have changes as the total base grows over time (and hence changes the count when independent). If this behaviour is not in line with requirements, the Count threshold can be changed to 0.

This applies to Column significativity on closed but you cannot perform the same calculation for Column significativity on numeric. The Count threshold setting exists in its advanced settings but it is not applicable and has no effect.

Link to this knowledge base article in our help centre