Results and Discussion Table 1 (top) shows the root mean square error (RMSE) between the three tests for different numbers of topics. These results show that all three tests largely agree with each other but as the sample size (number of topics) decreases, the agreement decreases. In line with the results found for 50 topics, the randomization and bootstrap tests agree more with the t-test than with each other. We looked at pairwise scatterplots of the three tests at the different topic sizes. While there is some disagreement among the tests at large p-values, i.e. those greater than 0.5, none of the tests would predict such a run pair to have a significant difference. More interesting to us is the behavior of the tests for run pairs with lower p-values. ≥ Table 1 (bottom) shows the RMSE among the three tests for run pairs that all three tests agreed had a p-value greater than 0.0001 and less than 0.5. In contrast to all pairs with p-values 0.0001 (Table 1 top), these run pairs are of more importance to the IR researcher since they are the runs that require a statistical test to judge the significance of the per- formance difference. For these run pairs, the randomization and t tests are much more in agreement with each other than the bootstrap is with either of the other two tests. Looking at scatterplots, we found that the bootstrap tracks the t-test very well but shows a systematic bias to produce p-values smaller than the t-test. As the number of topics de- creases, this bias becomes more pronounced. Figure 1 shows a pairwise scatterplot of the three tests when the number of topics is 10. The randomization test also tends to produce smaller p-values than the t-test for run pairs where the t- test estimated a p-value smaller than 0.1, but at the same time, produces some p-values greater than the t-test’s. As Figure 1 shows, the bootstrap consistently gives smaller p- values than the t-test for these smaller p-values. While the bootstrap and the randomization test disagree with each other more than with the t-test, Figure 1 shows that for a low number of topics, the randomization test shows less noise in its agreement with the bootstrap com- Figure 1: A pairwise comparison of the p-values less than 0.25 produced by the randomization, t-test, and the bootstrap tests for pairs of TREC runs with only 10 topics. The small number of topics high- lights the differences between the three tests. pared to the t-test for small p-values.
MEET AND DISCUSS A. Upon request of either party, the Chancellor and/or designees of the Chancellor shall during the term of this Agreement meet with a committee appointed by the Association for the purpose of discussing matters necessary to the implementation of this Agreement.
Notice and Disclaimer 2.1. The Data is the property of Xxx Xxxxxxxx and is protected by applicable copyright law. In no event shall User publish, retransmit, display, redistribute, or otherwise reproduce any or all of the Data in any format to anyone, except as allowed in Section 1 of this agreement.
Use and Disclosure All Confidential Information of a party will be held in confidence by the other party with at least the same degree of care as such party protects its own confidential or proprietary information of like kind and import, but not less than a reasonable degree of care. Neither party will disclose in any manner Confidential Information of the other party in any form to any person or entity without the other party’s prior consent. However, each party may disclose relevant aspects of the other party’s Confidential Information to its officers, affiliates, agents, subcontractors and employees to the extent reasonably necessary to perform its duties and obligations under this Agreement and such disclosure is not prohibited by applicable law. Without limiting the foregoing, each party will implement physical and other security measures and controls designed to protect (a) the security and confidentiality of Confidential Information; (b) against any threats or hazards to the security and integrity of Confidential Information; and (c) against any unauthorized access to or use of Confidential Information. To the extent that a party delegates any duties and responsibilities under this Agreement to an agent or other subcontractor, the party ensures that such agent and subcontractor are contractually bound to confidentiality terms consistent with the terms of this Section 11.
DISCIPLINE AND DISCHARGE 21.01 The Employer may warn, suspend, demote or discharge employees for just cause. If the conduct or performance of an employee warrants disciplinary action, such action shall be confirmed in writing. A copy of all such documentation shall be provided to the employee(s) involved and forwarded to the office of the Union at the time they are issued.
SUSPENSION AND DISCIPLINE 29.01 When an employee is suspended or discharged from duty, the Employer undertakes to notify the employee in writing, with a copy to the Association, of the reason for such suspension or discharge. The Employer shall endeavour to give such notification at the time of suspension or discharge.
DISCIPLINE AND DISCHARGE CASES 13:01 An employee who is discharged by the Employer shall, as soon as may be practicable thereafter, be given written notice thereof and a copy of such notice shall, within seven (7) working days after such discharge, be forwarded to the President of the Union, which said Notice shall contain the reason for the discharge of the said employee.
Uses and Disclosures Pursuant to the terms of this Agreement, Contractor may receive from the Exchange Protected Health Information and/or Personally Identifiable Information in connection with Contractor Exchange Functions that is protected under applicable Federal and State laws and regulations. Contractor shall not use or disclose such Protected Health Information or Personally Identifiable Information obtained in connection with Contractor Exchange Functions other than as is expressly permitted under the Exchange Requirements and only to the extent necessary to perform the functions called for within this Agreement.
