Partial reinforcement effect: The expectancy of reward on nonreward trials     

Roger L. Mellgren  John P. Lombardo  Dan M. Wrather  Robert Frank Weiss 《Learning & behavior》1973,1(2):105-108

In order to determine the importance of the development of expectancy of reward prior to partial reward trials; rats were given 20 continuously reinforced trials prior to 20 partially reinforced trials (CRF-PRF) and compared to Ss given only 20 partially reinforced trials (PRF). Control groups received 20 or 40 continuously reinforced trials (CRF-20, CRF-40) to determine the effect of differing numbers of acquisition trials. Results showed that terminal acquisition differences were minimal in the run segment of the alley and that Group CRF-PRF was more resistant to extinction than Group PRF, and both were more resistant to extinction than the CRF-20 and CRF-40 groups, which did not differ from each other. These results were interpreted as supporting the notion that the expectancy of reward on nonreward trials during partial reinforcement acquisition is a determiner of the magnitude of the partial reinforcement extinction effect.  相似文献   

Hurdle-jump responding in the rat as a function of conspecific odor of reward and nonreward     

Ira Collerain  H. Wayne Ludvigson 《Learning & behavior》1977,5(2):177-183

A hurdle-jump escape response was employed to assess the laboratory rat’s aversion or attraction to different types of conspecific odor. Odorant donor subjects received 112 runway acquisition trials on a continuous reward schedule followed by 32 extinction trials, 112 acquisition trials on a 50% schedule of reward and nonreward followed by 32 extinction trials, or 144 “neutral” trials with no reward in the alley. Different groups of test subjects escaped from odor excreted by odorant subjects on (a) nonrewarded acquisition and extinction trials, (b) rewarded trials during continuous reinforcement, (c) rewarded trials during partial reinforcement, or (d) neutral trials; others escaped from a clean box. The principal findings were: (1) significant aversion to “odor of nonreward” appeared after the donor odorants had received 12 exposures to reward; (2) production of odor of nonreward by odorant subjects changed as a function of training experience with reward; (3) after repeated exposure to odor of nonreward, the escape response habituated; (4) greater or different odor excretion in extinction resulted from subjects trained on a continuous reward schedule than on a partial reward schedule. Relationships of the data to frustration theory were discussed, assuming that inferred differences in production of odor reflect differences in frustration reaction.  相似文献   

The role of reinforcement and nonreinforcement in an operant frustration effect     

Larry F. Hughes  Lawrence Dachowski 《Learning & behavior》1973,1(1):68-72

Male albino rats were run in a discrete-trial two-bar operant analog of the double alley. Completion of a FR 4 response chain on the first bar was rewarded 50% of the time for the 12 experimental Ss, but was never rewarded for the 12 control Ss. Both groups received consistent reward at the end of a FR 4 chain on the second bar. Eighty-four trials were given at a rate of four trials per day. A significantly faster rate of responding on the second bar was found following nonrewarded first-bar ratios than following rewarded first-bar ratios. This frustration effect was not attributable to response depression, since the nonrewarded performance of the experimental group exceeded that of the control group.  相似文献   

Effects of sucrose concentrations on single-alternation performance in rats     

J. J. Franchina  J. M. Billig 《Learning & behavior》1978,6(3):320-329

In Experiment 1, rats received single-alternation training with 32% or 4% sucrose reward (Phase 1) followed by a shift in reward from 32% to 4%, and vice versa (Phase 2). In Phase 1, high reward facilitated alternation performance over low reward. In Phase 2, performance on rewarded trials increased as reward increased but was unchanged as reward decreased. Performance on nonrewarded trials showed negligible effects of shifts in reward. In Experiment 2, rats received goalbox placements with 32% or 4% sucrose alternated with nonreward in Phase 1; and in Phase 2, they received alternation runway training with the same or the opposite reward from that of placements. Performance on rewarded trials was faster, the higher the reward in runway training; performance on nonrewarded trials was slower, the higher the reward in placements. In Experiment 3, Phase 1 provided placements with 64%, 32%, 16%, or 4% sucrose or dry mash alternated with nonreward; Phase 2 provided alternation runway training with dry mash reward. Alternation prerformance developed more rapidly, the higher the sucrose concentration in placements. Only 64% sucrose produced performance superior to that for dry-mash placements.  相似文献   

Durability of the partial reinforcement and partial delay of reinforcement extinction effects after minimal acquisition training     

Mitri E. Shanab  Dana W. Birnbaum 《Learning & behavior》1974,2(2):81-85

Four groups of 10 rats each were given six acquisition trials (Phase 1) under continuous reinforcement (CR), partial reinforcement (PR), constant delay (CD), or partial delay of reinforcement (PD) conditions. In Phase 2, all Ss were given 18 nonreinforced trials, followed by 12 continuously reinforced trials in Phase 3. In Phase 4, all Ss were given 12 more extinction trials. A constant 24-h ITI was observed throughout the experiment. A strong partial reinforcement extinction effect (PREE) was obtained in both Phases 2 and 4. Only a temporary partial delay of reinforcement effect (PDRE) was observed, which was restricted to the first nine trials of the first extinction phase. No constant delay of reinforcement effect (CDRE) was observed in either extinction phase. The results were discussed in terms of both frustration and sequential theories.  相似文献   

The acquisition of a running response as a function of odor buildup,squad rotation,and introduction of naive subjects     

Robert E. Prytula  Stephen F. Davis  J. J. Fanning 《Learning & behavior》1981,9(4):556-560

A three-phase experiment was conducted in which rats received a double-alternation schedule of reward and nonreward. During Phase 1, the baseline period, double-alternation behavior was displayed earlier and more strongly by subjects run last in the daily sequence. This finding suggests that both reward and nonreward odor cues are cumulative over subjects. During Phase 2, a subject-rotation procedure was initiated; that is, each day the last subject in the previous day’s running sequence was moved to the first position in the sequence, etc. Rotation to the first position in the group led to an immediate disruption of responding. During Phase 3, two naive rats were inserted at the beginning of the running sequence and two at the end. The results, which showed that the naive animals placed at the end of the sequence acquired the patterning response much faster than those placed in the beginning positions, are interpreted as reflecting preparedness to respond to such intensified odors.  相似文献   

Effects of partial vs consistent reward in noncontingent pairings of stimuli with reward: A noncontingently produced positive contrast effect     

Elizabeth D. Capaldi  John R. Hovancik 《Learning & behavior》1974,2(1):39-42

Rats received pairings of two stimuli with reward noncontingently in the Skinner box. During noncontingent pairings, the bar was immobilized. For Group CC 100% of the presentations of both stimuli were rewarded (S₁ ±, S₂ ±), for Group PP 50% of the presentations of each stimulus were rewarded (S₁, ±, S₂±), and for Group PC one stimulus was followed by reward on 50% of its presentations, while the second stimulus was followed by reward on 100% of its presentations (S₁ ±, S₂ ±). A fourth group received the stimuli and reward nonpaired. In a subsequent rewarded test phase, the response facilitating effects of the stimuli were evaluated. In the test phase all groups that received reward paired with S₁, and S₂ performed better in the presence of S₁ and S₂ than the group for which the stimuli were not paired with reward. For groups that received the stimuli paired with reward, a difference due to schedule of reward occurred when schedule of reward was varied within Ss (Group PC), but not when varied between Ss (Group PP vs Group CC). The specific form of this finding was that Group PC’s performance in the presence of S₂ ± was more vigorous than its performance in the presence of S₁ ± and was more vigorous than the performance of Groups PP and CC to S₂. Group PC’s performance to S₁ ± did not differ from that of Groups PP and CC to S₁.  相似文献   

Extinction responding following partial reinforcement: The effects of number of rewarded trials and magnitude of reward     

Michael D. Morris  E. J. Capaldi 《Learning & behavior》1979,7(4):509-513

Rats were trained on a daily partial reward schedule of small magnitude of reward (S), nonreward (N), and large magnitude of reward (L), which began with SN or SSNN for all animals. The remainder of the daily schedule was defined by the factorial combination of the number of rewards (1 vs. 3) and the magnitude of reward (S vs. L). Following 18 days of such training, 20 trials of extinction were administered. It was found that increasing the number of rewarded trials in a partial reinforcement schedule decreased resistance to extinction. Furthermore, increased number of large-magnitude rewards reduced resistance to extinction to a greater extent than increased number of small-magnitude rewards.  相似文献   

Are there constraints on learned responses to odors from rewarded and nonrewarded rats?     

Paul J. Eslinger  H. Wayne Ludvigson 《Learning & behavior》1980,8(3):452-456

This study determined if test rats could utilize biological odors, generated from donor rats receiving reward (R) and frustrative nonreward (N) treatments, to predict reward and nonreward goal events equally well. In Phase 1, two groups of test rats were exposed to R and N odors that signaled, respectively, either R and N goal events (“same” condition) or N and R goal events (“opposite” condition). Rats demonstrated significant discriminative use of these odors under both conditions. Subjects in the “opposite” condition, however, were slightly slower to learn the discrimination. Reversal learning was readily accomplished in Phase 2, regardless of the same-opposite factor. Thus, little evidence for a constraint on learning was found, and an interpretation in terms of interfering response tendencies and their habituation seemed favored.  相似文献   

Extinction and food-reinforced inhibition of conditioned salivation in dogs     

Dennis L. Herendeen  Martin M. Shapiro 《Learning & behavior》1975,3(2):103-106

The present experiment compared two methods of eliminating a classically conditioned response in dogs, extinction and reinforcement of nonsalivation, using both a within- and between-subjects experimental design. Eighteen dogs were trained for 16 days in Phase I, 16 days in Phase II, and 8 days in Phase III. In Phase I, each subject received classical conditioning training to two stimuli. In Phase II, Group 1 received extinction training to one stimulus and reinforcement of nonsalivation to the other stimulus. Group 2 received continued classical conditioning training to one stimulus and reinforcement on nonsalivation training to the other. Group 3 received continued classical conditioning training to one stimulus and extinction training to the other. In both the within- and between-subjects comparisons, responding to the stimulus associated with extinction was eliminated faster than responding to the stimulus associated with reinforcement of nonsalivation.  相似文献   

The determinants of random choice     

Donna Bryant  Russell M. Church 《Learning & behavior》1974,2(4):245-248

The purpose of the present experiment was to describe a pattern of reinforcement sufficient to produce an unpredictable pattern of choice response by rats. On each trial two levers were inserted into an experimental chamber. If the reinforcement was always contingent upon single alternation (a simple pattern), Ss learned to alternate at significantly better than chance level; if reinforcement was contingent upon alternation on 50% of the trials (an insoluble pattern), Ss developed a position preference. To produce apparently random responding, the less preferred response (an alternation) was differentially reinforced on 75% of the trials. A simple stochastic model adequately described the results.  相似文献   

Sequences of reward magnitude and runway performance     

Edward L. Wike  Dennis D. King 《Learning & behavior》1973,1(3):175-178

Three groups of rats underwent 24 days of training and 12 days of extinction (three trials per day) in a runway under conditions of increasing (I), decreasing (D), and random (R) sequences of reward magnitudes (0, 45, and 500 mg). The I Ss ran faster over the daily trials, the D Ss slowed down, and the R Ss ran at approximately equal speeds on each trial. The patterned running observed in training persisted in extinction, with the R Ss running fastest and the I Ss next. The results were discussed in terms of Capaldi’s sequential theory and Amsel’s frustration theory.  相似文献   

Instrumental performance and time between reinforcements: Intimate relation to learning or memory retrieval?     

E. J. Capaldi  Suzan Alptekin  Kimberly M. Birmingham 《Learning & behavior》1996,24(2):211-220

According to scalar expectancy theory (SET), instrumental performance is determined by the ratio of the time between reinforcements in the trial (T _T) to the overall time between reinforcements (T _O). Groups for which theT _O|T _T ratio is the same should perform similarly. According to the sequential-memory view, the memory of nonreward becomes a signal for reward, and thereby promotes strong responding, when that memory is retrieved on a reward trial. In each of three runway investigations employing rats in a runway, two groups were compared that had the sameT _O |T _T ratio but that differed in the tendency to retrieve the memory of nonreward on a rewarded trial. In each investigation faster running on critical nonrewarded trials was associated with the group having the stronger tendency to retrieve the memory of nonreward on a rewarded trial. These findings are consistent with the predictions of the sequential-memory view, as well as with certain earlier findings, but are inconsistent with SET. It was indicated that the groups compared here were matched along a considerable number of dimensions—an unprecedented number for a varied reward investigation.  相似文献   

Effects of schedule and delay of reinforcement on acquisition speed     

E. J. Capaldi 《Learning & behavior》1978,6(3):330-334

The effects of schedule of reinforcement (partial vs. consistent) and delay of reward (0 to 20 sec) on running in rats were examined in two investigations. The effects of delay depended upon schedule of reinforcement; acquisition speed decreased as delay increased under consistent reinforcement, a common finding, while acquisition speed was independent of delay under partial reinforcement, a new finding. The partial-reinforcement acquisition effect or PRAE is defined as faster acquisition speed under partial than under consistent reinforcement. Because running speed was independent of delay under partial reinforcement, but decreased as delay increased under consistent reinforcement, the PRAE increased as delay of reinforcement increased.  相似文献   

Ontogeny of persistence: Immediate extinction effects in preweanling and weanling rats     

David R. Burdette  Stephen Brake  Jaw-Sy Chen  Abram Amsel 《Learning & behavior》1976,4(2):131-138

In Experiment I rats were trained for 21÷2 days under partial (PRF) or continuous reinforcement (CRF) conditions starting at 18, 22, 28, or 36 days of age and were then subjected to immediate extinction. At all ages there was a strong partial reinforcement extinction effect (PREE), and absolute size of PREE was greatest in the youngest rats. Rate of extinction increased as a function of age following both CRF and PRF. In Experiment II the youngest and oldest age groups of Experiment I were run under the two reward conditions of Experiment I and in a third condition, PRF with number of rewards rather than trials equated to CRF (PRF-R). The PRF-R and PRF groups were not different in extinction, and both were more persistent than CRF. The youngest rats were again more persistent than the oldest, particularly after PRF training. In Experiment III it was shown that the well-known paradoxical effect, greater reward in CRF acquisition leads to faster extinction, operates in our youngest and oldest animals, but is more pronounced in the oldest. The results are discussed in terms of whether they require different explanations than those often applied to extinction data from adult rats.  相似文献   

Discriminating between reward-produced memories: Effects of differences in reward magnitude     

E. J. Capaldi  Suzan Alptekin  Kimberly Birmingham 《Learning & behavior》1997,25(2):171-176

The greater the dissimilarity between exteroceptive stimuli, the easier it is to discriminate between them. To determine whether a similar relationship holds for memories produced by reward events, rats in three runway investigations received trials in pairs, the number of food pellets (0.045 g) occurring on Trial 1 indicating whether reward or nonreward would occur on Trial 2. In each investigation, discriminative responding on Trial 2 was better the larger the difference in reward magnitude on Trial 1. This finding was obtained under a wide variety of conditions: for example, when the larger of two reward magnitudes on Trial 1 signaled nonreward on Trial 2 (Experiment 1, 10 vs. 2 pellets); when the smaller of two reward magnitudes on Trial 1 signaled nonreward on Trial 2 (Experiment 2, 10 vs. 2 pellets); and when the same magnitude of reward on Trial 1 signaled nonreward on Trial 2 (Experiment 3, either 5 pellets or 0 pellets). The findings obtained here indicate that the greater the dissimilarity between reward magnitudes, the greater the dissimilarity between the memories they produced and, thus, the easier it is to discriminate between them. It is suggested that the present results may provide a basis for understanding findings obtained in other instrumental learning investigations in which reward magnitude is varied.  相似文献   

Replacement of event-generated memories of nonreinforcement with signal-generated memories of reinforcement during partial reinforcement training: Effect on resistance to extinction     

Steven J. Haggbloom  LaNeel Lovelace  Vickie R. Brewer  Shelia M. Levins  James D. Owens 《Learning & behavior》1990,18(3):315-322

Event-generated memory refers to the memory of a reinforcement (R) or nonreinforcement (N) event from an immediately preceding trial;signal-generated memory refers to the memory of a temporally remote R or N, retrieval of which is generated by presentation of a signal with which the memory is associated (Haggbloom, 1988). In each of three experiments, Group Signal-R received runway discrimination training in Phase 1 to establish a stimulus as a signal for R, and partial reinforcement training in Phase 2. An extinction test measured learning about the memory of nonreward (S^N)—learning that occurs when S^N is retrieved on R trials that follow N trials. In Group Signal-H, those R trials were accompanied by the signal for R, a treatment we hypothesized would generate retrieval of the memory of reinforcement (S^R) so that signal-generated S^R would replace event-generated S^N as the operative memory, thereby eliminating the increased resistance to extinction normally produced by PRF training. In each experiment, Group Signal-R was less resistant to extinction than was a control group conditioned to respond to-event-generated S^N. Extinction was as rapid in Group Signal-R as it was in a consistent reinforcement control group (Experiment 1) and in a group given intertrial reinforcements to interfere with learning about S^N (Experiment 3). Experiment 2 tested two alternative interpretations of the failure to learn about S^N in Group Signal-R. Those alternatives were found to be less viable than the hypothesis that the signal for R actively recruited retrieval of a competing memory.  相似文献   

Discrimination training in infant,preweanling, and weanling rats: Effects of prior learning experiences with the discriminanda     

Stephen C. Brake 《Learning & behavior》1978,6(4):435-443

Rats were given continuous reinforcement (CRF), partial reinforcement (PRF), or successive discrimination (D) training in an alley from 11–14 (Age 1) or 15–18 (Age 2) days of age. Reinforcement was the opportunity to suckle the dry nipples of an anesthetized dam. Following a 10-day interval, all animals were given 4 successive days of discrimination training with food pellets as reinforcement. Control groups were given only the second phase of training. In the first phase, D subjects of both ages responded appropriately to the discriminative stimuli, and the PRF subjects of both ages ran significantly slower than CRF subjects. In the second phase, only the CRF subjects of Age 1 showed behavioral discrimination. All three Age 2 groups discriminated, but the discrimination developed earliest after Phase I CRF and latest after Phase I PRF. Both Age 1 control groups showed a late-developing discrimination, but neither Age 2 control group discriminated. The results suggest that infant and preweanling rats can learn both positive and negative expectancies of appetitive events, respond appropriately, and retain and transfer these expectancies to new learning. The reinforcement value of dry suckling and the effects of stimulus preexposure in infant rats are also discussed.  相似文献   

Effects of intertrial reward and/or nonreward placements during a 20-second intertrial interval on single-alternation training in rats     

Joseph J. Franchina  Joseph X. Rice 《Learning & behavior》1976,4(4):411-415

Seventy male hooded rats received single-alternation runway training in which goalbox placements were interpolated during the 20-sec intertrial interval. Placements provided alternating reward/ nonreward, random reward/nonreward, continuous reward, or continuous nonreward. Relative to nonplaced controls, alternation performance was reliably facilitated only by intertrial alternation placements which re-presented the goal event of each immediately preceding instrumental trial. All other intertrial procedures reliably impaired alternation performance. Degree of impairment was graded from least to most as follows: intertrial alternation placements with the goal event opposite to that of each immediately preceding instrumental trial, intertrial placements with continuous non-reward, intertrial placements with continuous reward, and intertrial placements with random reward/nonreward.  相似文献   

Criteria for the Evaluation of High-School English Composition     

《The Journal of educational research》2012,105(3):108-112

Abstract

Normals, Institutionalized retardates, and non-Institutionallzed retardates, matched on the basis of MA, were tested on a simple performance task under social and tangible reinforcement conditions. Differences in performance under the two reinforcement conditions were belle red to reflect differences In the motivational systems of the groups. The performances of the normals and institutionalized retardates were very similar, as these two groups did not perform significantly longer or faster than each other on the task. The non-institutionalized retardates performed significantly longer than either of the other two groups, and significantly faster than the Institutionalized retardate group. This result was explained In terms of the greater frustration and failure which these Ss may experience In their daily lives.  相似文献