Flickr-8k definition

Flickr-8k. The Flickr-8K dataset contains qual- ity judgements for 5,822 sentences17 (▇▇▇▇▇▇▇ and ▇▇▇▇▇▇, 2014)18. Each sentence was a description of an image. The annotation was carried out by 3 human experts who judged the sentence semantic correctness in a scale from 1 to 4. Because we don’t have the information about how the data were collected, in order to decide which kind of analysis to carry out on the Flickr- 8k dataset we plot the distribution of the categories used by the judges. Figure 3 suggests that the data do not have a normal distribution, and so we opt for the use of nonparametric statistics. As in the previous case we used ▇▇▇▇▇▇▇ and ▇▇▇▇▇▇▇’s Gamma and ▇▇▇▇▇▇’ κ to carry out our analysis. For ▇▇▇▇▇▇▇ and ▇▇▇▇▇▇▇’s Gamma, we report the average results of the pairwise measure be- tween the annotators. This method is suggested by ▇▇▇▇▇▇ and ▇▇▇▇▇▇▇▇▇ (1988) for the case of ▇▇▇▇▇▇▇ τ correlation coefficient, which is a variant of the ▇▇▇▇▇▇▇ and ▇▇▇▇▇▇▇’s Gamma. Figure 3: Distribution of the categories used by the judges in the Flickr-8k dataset. The measurements give a Fleiss’ value of 0.52 and a Gamma value of 0.98. Following the Krip- pendorff interpretation of IAA, the annotation has to be considered not reliable. However, the an- notation achieves a very high correlation, which suggests a high relative consistency between the judges. Indeed, when they are in disagreement, judge 2 ranks systematically higher than judge 1, and judge 3 ranks systematically higher than judge
View Source

Related to Flickr-8k

  • hostel means a place of residence for the students of the University, or its colleges, institutions and study centers, established or recognized to be as such by the University;

  • Stillbirth means a stillbirth resulting from a person’s pregnancy, the pregnancy of a person’s current spouse or domestic partner, or another individual, if the person would have been a parent of a child born as a result of the pregnancy that ended in stillbirth.

  • POPI means the Protection of Personal Information Act, 4 of 2013;

  • Subscriber Management System means a system or device which stores the subscriber records and details with respect to name, address and other information regarding the hardware being utilized by the subscriber, channels or bouquets of channels subscribed by the subscriber, price of such channels or bouquets of channels as defined in the system, the activation or deactivation dates and time for any channel or bouquets of channels, a log of all actions performed on a subscriber’s record, invoices raised on each subscriber and the amounts paid or discount allowed to the subscriber for each billing period, and which complies with the requirements as set out under Annexure D of this Agreement;

  • SDSL or "Symmetric Digital Subscriber Line" is a baseband DSL transmission technology that permits the bi-directional transmission from up to 160 kbps to 2.048 Mbps on a single pair. "VDSL" or "Very High Speed Digital Subscriber Line" is a baseband DSL transmission technology that permits the transmission of up to 52 Mbps downstream (from the Central Office to the End User Customer) and up to 2.3 Mbps digital signal upstream (from the End User Customer to the Central Office). VDSL can also be 26 Mbps symmetrical, or other combination.